-- Logs begin at Mon 2022-05-16 14:13:51 UTC, end at Mon 2022-05-16 15:43:17 UTC. -- May 16 15:05:37.999392 dv-cinder-841753-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 15:05:38.009140 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 15:05:38 2022] *** May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: nodename: dv-cinder-841753-2-iscsi May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: machine: x86_64 May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: clock source: unix May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: pcre jit disabled May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: detected number of CPU cores: 4 May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: current working directory: / May 16 15:05:38.011089 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: detected binary path: /usr/bin/uwsgi-core May 16 15:05:38.011746 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: your processes number limit is 47680 May 16 15:05:38.011746 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: your memory page size is 4096 bytes May 16 15:05:38.011746 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: detected max file descriptor number: 2048 May 16 15:05:38.011746 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: lock engine: pthread robust mutexes May 16 15:05:38.011746 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: thunder lock: enabled May 16 15:05:38.011746 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 15:05:38.011746 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 15:05:38.057053 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: Python main interpreter initialized at 0x5623eed1e9c0 May 16 15:05:38.057053 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: python threads support enabled May 16 15:05:38.057053 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: your server socket listen backlog is limited to 100 connections May 16 15:05:38.057053 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: your mercy for graceful operations on workers is 90 seconds May 16 15:05:38.057415 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: mapped 403077 bytes (393 KB) for 2 cores May 16 15:05:38.057491 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: *** Operational MODE: preforking *** May 16 15:05:38.057708 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: *** uWSGI is running in multiple interpreter mode *** May 16 15:05:38.057708 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: spawned uWSGI master process (pid: 103288) May 16 15:05:38.057894 dv-cinder-841753-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 15:05:38.058462 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: spawned uWSGI worker 1 (pid: 103289, cores: 1) May 16 15:05:38.058774 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: spawned uWSGI worker 2 (pid: 103290, cores: 1) May 16 15:05:38.058938 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 15:05:39.254512 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:05:39.279473 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:05:39.984007 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:05:39.984007 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: from cryptography.utils import int_from_bytes May 16 15:05:39.984326 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:05:39.984326 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: from cryptography.utils import int_from_bytes May 16 15:05:40.000310 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:05:40.000310 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: from cryptography.utils import int_from_bytes May 16 15:05:40.000632 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:05:40.000632 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: from cryptography.utils import int_from_bytes May 16 15:05:42.621188 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:05:42.621746 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:05:42.621953 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:05:42.622306 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:05:42.622584 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:05:42.622946 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.623267 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.623586 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.623924 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.624249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.624556 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.624872 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.625186 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.625508 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.625600 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:05:42.625981 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.626072 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:05:42.626152 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.626371 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:05:42.626459 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841753-2-iscsi {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.626685 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.626780 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:05:42.626972 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:05:42.627066 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.627281 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.627366 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.627595 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.627714 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.627922 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.628017 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.628238 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.628333 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.629170 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.629259 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.629675 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.630066 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.630066 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.630302 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.630411 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.630515 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.630706 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.630820 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.630970 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.631106 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.631290 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.631377 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.631619 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841753-2-iscsi {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.631736 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.631956 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.632047 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.632263 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.632349 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.632576 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.632707 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.632879 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.632970 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.633185 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.633272 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841753-2-iscsi {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.633509 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.633610 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.633818 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.633925 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.634171 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.634320 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.634580 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.634679 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.634890 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.634983 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.635198 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.635379 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.635516 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.635612 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.635862 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.635950 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.636168 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.636268 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.636485 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.636578 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.636792 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.636895 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.637107 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.637194 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.637413 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.637512 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.637710 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.637805 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841753-2-iscsi {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.638016 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.638109 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.638323 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.638411 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.638635 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.638722 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.638939 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.639110 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.639240 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.639424 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.639512 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.639757 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.639858 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.640082 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.640178 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.640408 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.640495 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.640721 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.640809 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.640970 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.641068 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.641220 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.641354 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.641536 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.641680 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.641855 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.641997 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.642160 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.642300 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.642467 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.642608 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.642778 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.642936 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.643083 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.643223 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.643389 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.643530 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.643796 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.643944 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.644689 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.644788 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.645106 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.645258 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.645607 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.645704 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.645929 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.646024 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.646252 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.646354 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.646546 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.646646 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.646802 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.646901 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.647130 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.647248 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.647456 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.647543 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.647791 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.647894 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.648105 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.648194 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.648415 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.648509 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.648725 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.648811 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.649034 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.649128 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.649345 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.649433 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.649649 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.649742 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.649953 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.650042 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.650257 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.650351 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.650574 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.650680 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.650895 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.650981 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.651195 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.651281 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.651445 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.651544 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.651778 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.651936 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.652082 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.652192 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.652398 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.652495 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.652704 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.652831 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.653007 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.653152 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.653310 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.653461 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.653608 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.653782 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.653911 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.654106 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.654209 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.654414 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.654501 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.654723 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.654818 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.655030 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.655130 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.655350 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.655438 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.655681 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.655772 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.655989 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.656086 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.656239 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.656333 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.656542 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.656629 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.656847 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.656942 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.657166 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.657252 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.657474 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.657567 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.657776 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.657870 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.658081 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.658169 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.658380 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.658482 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.658688 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.658782 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.658991 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.659126 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.659297 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.659383 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.659598 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.659727 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.660093 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.660190 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.660421 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.660579 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.660736 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.660898 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.661044 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.661214 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.661362 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.661530 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.661701 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.661871 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.662010 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.662176 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.662263 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.662487 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.662589 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.662797 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.662885 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.663105 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.663205 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.663414 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.663511 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.663737 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.663846 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.664054 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.664141 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.664359 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.664454 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.664663 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.664749 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.664961 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.665058 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.665267 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.665354 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.665583 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.665670 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.665888 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.665976 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.666191 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.666279 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.666494 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.666580 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.666792 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.666879 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.667100 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.667187 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.667416 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.667503 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.667748 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.667849 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.668060 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.668148 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.668364 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.668461 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.668670 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.668770 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.668974 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.669061 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.669279 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.669365 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.669582 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.669683 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.669888 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.669975 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.670188 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.670283 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.670510 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.670607 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.670826 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.670912 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.671131 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.671216 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.671441 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.671536 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.672024 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.672112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.672344 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:42.672442 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.672657 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.672750 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.672974 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.673061 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.673288 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.673380 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.673605 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.673693 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.673932 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.674018 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.674252 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.674345 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.674563 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.674661 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.674877 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.674963 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.675192 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.675290 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.675558 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.675675 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.675909 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.676218 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.676344 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.676550 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.676653 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.676874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.676962 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.677202 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.677289 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.677528 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.677624 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.677865 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.677958 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.678184 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.678269 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.678503 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.678591 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.678813 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.678908 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.679124 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.679212 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.679431 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.679520 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.679780 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.679870 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.680091 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.680178 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.680406 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.680502 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.680729 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.680816 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.681041 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.681135 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.681351 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.681440 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.681667 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.681753 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.681978 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.682074 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.682288 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.682380 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.682594 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.682681 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.682896 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.682992 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.683198 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.683331 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.683499 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.683589 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.683830 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.683999 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.684133 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.684229 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.684452 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.684541 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.684769 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.684865 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.685071 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.685157 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.685381 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.685473 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.685691 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.685778 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.686000 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.686088 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.686311 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.686397 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.686621 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.686713 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.686925 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.687012 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.687234 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.687322 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.687544 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.687663 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.687873 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.687960 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.688185 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.688280 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.688491 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.688579 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.688795 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.688881 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.689098 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.689193 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.689408 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.689494 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.689711 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.689797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.690022 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.690189 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.690332 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.690422 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.690644 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.690730 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.691495 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.691596 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.691837 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.692133 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.692234 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.692456 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.692554 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.692762 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.692850 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.693076 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.693164 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.693386 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.693529 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.693701 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.693788 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.694013 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.694101 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.694323 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.694457 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.694632 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.694718 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.694934 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.695029 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.695241 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.695337 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.695543 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.695652 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.695869 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.695967 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.696169 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.696266 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.696477 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.696564 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.696777 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.696864 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.697078 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.697175 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.697380 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.697481 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.697680 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.697767 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.697978 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.698066 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.698295 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.698383 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.698600 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.698686 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.698899 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.698987 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.699200 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.699287 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.699500 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.699596 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.699863 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.699964 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.700168 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.700257 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.700495 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.700591 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.700800 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.700888 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.701109 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.701198 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.701415 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.701515 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.701719 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.701814 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.702022 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.702109 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.702328 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.702427 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.702630 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.702724 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.703022 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.703238 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.703335 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.703543 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.703659 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.703871 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.703960 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.704193 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.704294 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.704506 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.704601 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.704812 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.704899 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.705116 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.705203 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.705418 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.705515 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.705718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.705804 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.706032 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.706121 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.706367 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.706454 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.707257 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.707397 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.707593 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.707950 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.708040 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.708257 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.708354 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.708571 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.708668 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.708879 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.708968 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.709188 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.709274 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.709495 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.709583 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.709803 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.709896 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.710115 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.710202 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.710419 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.710506 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.710740 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.710828 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.711047 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.711135 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.711358 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.711446 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.711679 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.711768 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.711995 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.712082 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.712294 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.712383 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.712603 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.712694 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.712917 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.713013 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.713242 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.713335 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.713549 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.713636 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.713857 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.714034 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.714170 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.714258 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.714474 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.714561 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.714779 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.714889 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.715084 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.715172 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.715383 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.715471 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.715713 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.715821 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.716021 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.716109 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.716330 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.716416 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.716635 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.716732 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.716941 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.717027 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.717241 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.717328 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.717551 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.717638 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.717854 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.717950 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.718151 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.718237 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.718449 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.718540 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.718752 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.718840 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.719068 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.719166 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.719373 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.719461 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.719710 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.719802 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.720023 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.720109 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.720320 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.720407 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.720624 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.720712 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.720941 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.721038 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.721247 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.721344 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.721548 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.721642 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.721845 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.721940 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.722167 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.722324 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.722509 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.722670 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.722810 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.723159 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.723248 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.723480 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.723575 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.723817 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.723917 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.724135 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.724225 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.724449 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.724538 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.724756 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.724855 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.725060 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.725154 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.725374 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.725469 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.725683 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.725787 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.725988 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.726075 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.726294 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.726381 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.726600 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.726703 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.726905 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.726991 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.727207 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.727293 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.727523 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.727619 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.727856 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.727943 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.728162 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.728259 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.728465 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.728560 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.728764 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.728858 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.729069 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.729163 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.729382 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.729471 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.729690 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.729949 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.730036 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.730284 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.730380 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.730606 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.730701 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.730918 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.731004 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.731230 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.731326 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.731540 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.731676 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.731886 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.731974 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.732199 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.732288 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.732507 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.732595 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.732818 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.732924 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.733125 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.733219 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.733429 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.733517 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.733732 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.733877 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.734043 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.734175 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.734348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.734449 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.734649 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.734763 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.734950 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.735056 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.735250 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.735344 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.735548 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.735670 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.735876 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.735987 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.736173 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.736429 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.736516 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.736762 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.736847 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.737058 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.737146 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.737366 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.737453 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.737664 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.737761 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.738024 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.738151 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.738331 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.738613 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.738700 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.738921 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.739007 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.739221 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.739308 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.739560 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.739679 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.739889 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.739989 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.740194 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.740280 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.740506 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.740594 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.740820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.740922 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.741129 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.741218 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.741433 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.741528 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.741736 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.741832 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.742040 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.742127 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.742341 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.742435 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.742638 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.742739 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.742942 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.743039 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.743243 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.743340 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.743541 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.743648 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.743872 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.744048 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.744213 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.744297 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.744465 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.744562 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.744783 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.744894 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.745095 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.745195 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.745399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.745497 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.745702 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.745794 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.746005 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.746103 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.746308 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.746394 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.746612 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.746699 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.746912 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.747008 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.747219 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.747307 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.747526 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.747621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.747850 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.747949 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.748157 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.748253 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.748458 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.748547 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.748769 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.748865 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.749069 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.749157 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.749369 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.749456 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.749670 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.749759 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.749976 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.750065 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.750277 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.750363 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.750582 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.750669 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.750891 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.750977 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.751196 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.751282 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.751497 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.751586 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.751821 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.751911 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.752129 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.752217 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.752427 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.752515 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.752728 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.752815 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.753034 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.753135 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.753334 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.753983 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.754181 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.754322 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.754482 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.754784 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.754874 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.755269 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.755411 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.755521 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.755676 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.755779 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.755862 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.755983 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.756079 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.756283 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.756371 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.756581 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.756669 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.756879 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.756966 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.757177 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.757273 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.757475 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.757570 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.757792 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.757879 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.758091 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.758187 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.758390 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.758476 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.758689 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.758777 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.758988 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.759085 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.759287 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.759375 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.759598 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.759803 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.759927 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.760027 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.760230 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.760319 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.760538 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.760637 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.760861 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.760951 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.761166 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.761260 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.761466 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.761553 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.761773 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.761868 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.762074 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.762161 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.762377 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.762466 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.762678 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.762767 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.762984 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.763070 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.763284 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.763380 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.763579 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.763686 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.763916 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.764002 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.764219 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.764329 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.764519 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.764610 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.764832 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.764918 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.765138 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.765237 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.765442 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.765538 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.765737 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.765823 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.766033 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.766129 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.766337 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.766431 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.766642 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.766730 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.766946 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.767118 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.767250 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.767338 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.767555 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.767662 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.767887 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.767985 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.768192 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.768280 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.768497 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.768584 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.768800 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.768890 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.769646 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.769854 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.769942 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.770248 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.770397 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.770552 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.770718 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.770872 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.771035 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.771177 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.771342 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.771476 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.771679 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.771788 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.771998 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.772085 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.772311 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.772408 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.772623 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.772713 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.772943 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.773072 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.773270 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.773387 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.773591 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.773682 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.773894 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.773998 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.774208 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.774310 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.774518 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.774616 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.774836 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.774931 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.775143 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.775230 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.775439 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.775535 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.775782 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.775884 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.776097 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.776185 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.776407 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.776494 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.776721 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.776810 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.777032 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.777123 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.777340 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.777429 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.777651 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.777740 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.777962 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.778049 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.778258 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.778351 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.778559 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.778647 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.778858 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.778945 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.779168 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.779262 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.779465 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.779559 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.779792 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.779893 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.780105 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.780202 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.780407 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.780495 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.780792 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.780887 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.781134 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.781230 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.781445 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.781534 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.781757 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.781846 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.782069 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.782166 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.782380 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.782469 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.782696 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.782783 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.782994 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.783093 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.783300 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.783395 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.783602 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.783750 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.783944 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.784034 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.784263 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.784398 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.784570 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.784693 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.784942 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.785270 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.785491 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.785582 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.785677 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.785869 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.785992 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.786176 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.786322 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.786494 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.786646 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.786903 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.787002 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.787214 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.787328 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.787518 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.787607 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.787857 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.787946 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.788179 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.788279 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.788478 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.788599 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.788779 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.788915 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.789099 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.789224 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.789402 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.789640 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.789728 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.789956 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.790070 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.790266 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.790354 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.790585 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.790672 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.790889 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.790991 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.791192 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.791281 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.791492 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.791581 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.791818 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.791924 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.792134 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.792229 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.792431 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.792518 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.792746 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.792838 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.793052 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.793141 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.793368 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.793503 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.793671 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.793767 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.793969 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.794055 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.794284 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.794379 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.794590 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.794688 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.794886 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.794983 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.795184 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.795311 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.795481 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.795675 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.795841 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.795972 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.796140 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.796297 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.796455 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.796877 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.797032 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.797182 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.797355 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.797486 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.797661 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.797813 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.797986 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.798103 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.798307 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.798404 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.798618 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.798706 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.798934 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.799061 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.799252 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.799345 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.799550 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.799666 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.799874 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.799972 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.800181 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.800766 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.801005 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.801139 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.801304 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.801651 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.801776 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.801988 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.802090 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.802325 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.802418 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.802642 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.802739 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.802947 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.803034 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.803263 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.803350 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.803561 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.803684 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.803905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.803993 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.804211 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.804298 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.804518 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.804681 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.804823 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.804960 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.805108 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.805249 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.805420 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.805562 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.805724 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.805827 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.806040 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.806127 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.806350 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.806437 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.806666 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.806754 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.806980 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.807075 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.807289 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.807382 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.807593 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.807725 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.807928 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.808064 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.808240 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.808335 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.808549 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.808645 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.808851 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.808959 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.809157 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.809256 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.809459 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.809545 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.809764 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.809860 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.810066 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.810153 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.810366 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.810459 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.810675 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.810771 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.810980 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.811076 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.811283 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.811504 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.811600 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.811881 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.811974 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.812174 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.812263 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.812486 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.812583 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.812796 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.812883 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.813105 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.813191 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.813408 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.813505 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.813711 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.813806 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.814017 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.814104 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.814327 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.814415 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.814638 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.814746 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.814960 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.815066 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.815278 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.815380 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.815602 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.815711 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.816504 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.816608 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.817048 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.817137 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.817366 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.817519 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.817684 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.817840 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.818000 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.818160 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.818352 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.818486 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.818669 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.818803 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.818976 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.819120 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.819291 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.819436 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.819601 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.819880 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.819975 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.820198 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.820285 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.820514 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.820615 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.820833 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.820921 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.821147 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.821349 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.821494 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.821679 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.821820 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.821996 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.822128 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.822313 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.822471 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.822612 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.822748 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.822936 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.823069 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.823250 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.823388 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.823598 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.823720 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.823887 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.823977 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.824195 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.824298 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.824503 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.824713 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.824816 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.825027 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.825183 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.825356 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.825491 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.825678 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.825817 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.825996 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.826134 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.826308 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.826457 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.826623 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.826767 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.826944 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.827089 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.827239 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.827390 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.827529 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.827697 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.827859 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.828000 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.828149 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.828307 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.828442 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.828581 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.828759 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.828898 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.829068 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.829204 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.829370 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.829504 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.829688 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.829821 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.829995 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.830132 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.830303 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.830520 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.830661 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.830864 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.831008 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.831183 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.831321 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.831519 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.831686 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.831913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.832083 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.832312 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.832468 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.832588 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.832793 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.832911 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.833112 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.833221 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.833430 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.833531 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.833825 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.833950 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.834135 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.834253 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.834438 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.834586 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.834738 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.834914 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.835036 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.835248 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.835359 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.835569 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.835714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.835913 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.836000 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.836230 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.836332 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.836536 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.836622 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.836839 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.836924 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.837140 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.837239 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.837442 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.837530 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.837746 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.837839 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.838044 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.838139 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.838344 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.838431 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.838643 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.838729 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.838942 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.839030 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.839247 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.839371 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.839548 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.842216 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.842381 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.842494 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.842600 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.842600 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.842795 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.842909 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843030 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843138 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843250 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843357 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843461 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843565 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843725 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843840 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.843946 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.844052 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.844651 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.844749 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.844832 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.844919 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845064 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845153 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845242 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845362 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845449 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845529 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845608 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845686 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845778 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845859 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845938 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.845938 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846092 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846172 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846264 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846352 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846432 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846512 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846512 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846665 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846753 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846841 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.846922 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.847001 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.847080 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.847206 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.847300 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.847370 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.847457 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.847619 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.847728 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.848043 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.848145 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.848344 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.848432 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.848651 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.848738 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.848957 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.849046 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.849263 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.849350 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.849567 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.849668 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.849872 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.849961 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.850178 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.850266 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.850483 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.850583 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.850789 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.850877 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.851101 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.851192 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.851411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.851508 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.851741 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.851843 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.852062 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.852157 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.852375 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.852543 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.852685 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.852778 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.853005 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.853090 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.853310 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.853397 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.853615 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.853710 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.853920 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.854007 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.854227 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.854480 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.854569 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.854816 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.854903 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.855137 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.855234 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.855437 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.855522 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.855820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.855908 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.856130 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.856227 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.856437 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.856525 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.856741 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.856827 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.857064 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.857160 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.857377 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.857476 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.857688 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.857775 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.857992 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.858078 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.858300 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.858385 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.858606 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.858691 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.858914 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.859007 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.859222 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.859308 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.859532 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.859684 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.859864 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.859992 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.860171 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.860267 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.860468 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.860563 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.860773 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.860868 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.861086 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.861180 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.861400 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.861496 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.861708 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.861841 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.862008 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.862104 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.862307 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.862396 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.862611 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.862701 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.863487 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.863741 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.863862 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.864115 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.864209 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.864457 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.864554 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.864761 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.864857 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.865063 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.865158 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.865364 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.865454 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.865664 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.865754 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.865964 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.866051 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.866264 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.866429 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.866564 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.866748 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.866868 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.867074 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.867175 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.867401 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.867502 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.867745 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.867885 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.868050 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.868163 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.868351 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.868475 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.868678 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.868794 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.869000 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.869127 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.869311 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.869432 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.869628 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.869742 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.869935 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.870048 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.870250 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.870373 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.870555 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.870668 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.870871 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.870984 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.871173 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.871337 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.871479 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.871594 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.871810 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.871936 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.872129 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.872244 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.872436 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.872548 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.872737 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.872859 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.873041 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.873137 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.873344 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.873430 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.873648 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.873743 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.873951 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.874039 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.874251 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.874338 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.874555 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.874660 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.874862 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.874950 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.875163 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.875258 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.875466 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.875557 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.875790 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.875881 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.876092 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.876180 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.876395 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.876485 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.876696 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.876783 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.877002 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.877089 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.877307 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.877397 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.877606 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.877693 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.877908 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.878003 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.878207 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.878301 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.878589 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.878720 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.878899 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.879180 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.879269 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.879525 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.879614 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.879855 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.879955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.880177 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.880265 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.880489 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.880582 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.880813 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.880900 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.881125 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.881213 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.881444 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.881531 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.881766 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.881929 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.882076 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.882163 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.882384 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.882472 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.882687 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.882783 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.882934 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:05:42.883058 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.883314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.883648 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.883960 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.884274 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.884584 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.884911 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.885237 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.885545 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.885867 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.886185 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.886506 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.886821 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.887133 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.887461 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.887794 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.888106 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.888424 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.888735 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.889046 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.889361 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.889676 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.889999 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.890321 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.890631 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.890956 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.891282 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.891640 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.891957 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.892299 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.892625 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.892941 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.893255 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.893559 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:42.893802 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:05:42.906544 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_db.sqlalchemy.engines [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:42.918274 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:42.969764 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.context [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0d3babb-5d7b-45d9-bcb1-3c089af1ca15(cell1) {{(pid=103290) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:05:42.974738 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:05:42.976363 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:05:42.977141 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:05:42.979058 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:05:42.982549 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.context [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0d3babb-5d7b-45d9-bcb1-3c089af1ca15(cell1) {{(pid=103289) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:05:42.986892 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:05:42.988834 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:05:42.989663 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:05:42.989851 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_db.sqlalchemy.engines [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:42.991685 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:05:42.992973 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_db.sqlalchemy.engines [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:43.004672 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:43.007306 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:43.162238 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_db.sqlalchemy.engines [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:43.169371 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:43.574229 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: WARNING keystonemiddleware.auth_token [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:05:43.582182 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: WARNING keystonemiddleware.auth_token [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:05:43.621359 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:05:43.628705 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:05:43.931494 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: WARNING keystonemiddleware.auth_token [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:05:43.937639 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: WARNING keystonemiddleware.auth_token [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:05:43.944483 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5623eed1e9c0 pid: 103290 (default app) May 16 15:05:43.946531 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:05:43.947730 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] 10.222.0.71 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 May 16 15:05:43.948135 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 788 bytes} [Mon May 16 15:05:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:05:43.974866 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:05:43.981004 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-949ee2d2-aebb-40c8-b1c3-b2c2f2d9bfe8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:05:43.987179 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5623eed1e9c0 pid: 103289 (default app) May 16 15:07:03.736044 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:03.737844 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 16 15:07:03.738238 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:04.166286 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-536af8d3-7c25-4db4-922d-17dfee0587b7 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:04.195523 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-536af8d3-7c25-4db4-922d-17dfee0587b7 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.450532 May 16 15:07:04.196571 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 1/3] 10.222.0.71 () {60 vars in 1291 bytes} [Mon May 16 15:07:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:06.482548 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:06.483557 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-4c9d2540-bcee-454c-90b6-db61b4bf06ed None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 16 15:07:06.483996 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 3/4] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:06.550297 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-43149307-6a48-41ce-abf6-12904a1d497b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:06.569212 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:07:06.569212 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: warnings.warn(msg) May 16 15:07:06.648599 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-43149307-6a48-41ce-abf6-12904a1d497b admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.157779 May 16 15:07:06.649544 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 2/5] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:06.871122 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-be31e408-ee30-4b43-ab80-a40585f061fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:06.873378 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:07:06.873378 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: warnings.warn(msg) May 16 15:07:06.987705 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-be31e408-ee30-4b43-ab80-a40585f061fa admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.329727 May 16 15:07:06.988577 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 4/6] 10.222.0.71 () {64 vars in 1335 bytes} [Mon May 16 15:07:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:09.258681 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-43149307-6a48-41ce-abf6-12904a1d497b admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:09.259723 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-43149307-6a48-41ce-abf6-12904a1d497b admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 16 15:07:09.260145 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 3/7] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:09.363925 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-474b7653-8055-4ba0-878b-ef928b97edb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:09.382063 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:07:09.382063 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: warnings.warn(msg) May 16 15:07:09.471469 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-474b7653-8055-4ba0-878b-ef928b97edb6 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.204808 May 16 15:07:09.472261 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 5/8] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:09.484341 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-a002beb9-59ac-4e92-9f04-ad1f7b340bbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:09.485809 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:07:09.485809 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: warnings.warn(msg) May 16 15:07:09.588433 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-a002beb9-59ac-4e92-9f04-ad1f7b340bbc admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107649 May 16 15:07:09.591870 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 4/9] 10.222.0.71 () {64 vars in 1335 bytes} [Mon May 16 15:07:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:11.877265 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-474b7653-8055-4ba0-878b-ef928b97edb6 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:11.878419 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-474b7653-8055-4ba0-878b-ef928b97edb6 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002196 May 16 15:07:11.878927 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:11.948877 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-3f008610-badf-41a4-8a7d-f8c8b62f8147 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "rxtx_factor": 1.0}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:12.037205 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-3f008610-badf-41a4-8a7d-f8c8b62f8147 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152330 May 16 15:07:12.038167 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 5/11] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:12.051197 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-7233b241-aa83-402d-bed2-f46161645a56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:12.121833 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-7233b241-aa83-402d-bed2-f46161645a56 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075808 May 16 15:07:12.131951 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 7/12] 10.222.0.71 () {64 vars in 1335 bytes} [Mon May 16 15:07:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:14.425474 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-3f008610-badf-41a4-8a7d-f8c8b62f8147 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:14.426487 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-3f008610-badf-41a4-8a7d-f8c8b62f8147 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 16 15:07:14.426900 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 6/13] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:14.486457 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-9803a519-117b-4d0f-bc5c-5dd548a49f7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:14.580772 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-9803a519-117b-4d0f-bc5c-5dd548a49f7e admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148006 May 16 15:07:14.581329 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 8/14] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:14.593421 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-f6a8e161-1c06-4730-8641-da69566c951e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:14.681365 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-f6a8e161-1c06-4730-8641-da69566c951e admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091640 May 16 15:07:14.681964 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 7/15] 10.222.0.71 () {64 vars in 1335 bytes} [Mon May 16 15:07:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:07:17.011195 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-9803a519-117b-4d0f-bc5c-5dd548a49f7e admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:17.012302 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-9803a519-117b-4d0f-bc5c-5dd548a49f7e admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 16 15:07:17.012892 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 9/16] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:17.072150 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-4fe20e64-0636-4222-9ed4-13ca16869324 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:17.152014 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-4fe20e64-0636-4222-9ed4-13ca16869324 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133272 May 16 15:07:17.152501 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 8/17] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:17.165757 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-85da3df1-00e3-4d35-8b72-606f5a64ae69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:17.246866 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-85da3df1-00e3-4d35-8b72-606f5a64ae69 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085429 May 16 15:07:17.247447 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 10/18] 10.222.0.71 () {64 vars in 1335 bytes} [Mon May 16 15:07:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:07:19.523294 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-4fe20e64-0636-4222-9ed4-13ca16869324 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:19.524229 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-4fe20e64-0636-4222-9ed4-13ca16869324 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 16 15:07:19.524626 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 9/19] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:07:19.585701 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-d220306d-a017-43ff-8823-2d9869d58845 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:19.610944 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-d220306d-a017-43ff-8823-2d9869d58845 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079670 May 16 15:07:19.618557 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 11/20] 10.222.0.71 () {60 vars in 1291 bytes} [Mon May 16 15:07:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:07:21.893977 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-4fe20e64-0636-4222-9ed4-13ca16869324 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:21.894980 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-4fe20e64-0636-4222-9ed4-13ca16869324 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 16 15:07:21.895387 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 10/21] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:21.958645 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-5e020761-4cb1-4296-b45b-a36d2269a6df admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:22.037001 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-5e020761-4cb1-4296-b45b-a36d2269a6df admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.134072 May 16 15:07:22.037717 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 12/22] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:22.050940 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-2eb25307-fdb3-4bd6-aa40-a8e910ddb85a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:22.143322 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-2eb25307-fdb3-4bd6-aa40-a8e910ddb85a admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096513 May 16 15:07:22.144042 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 11/23] 10.222.0.71 () {64 vars in 1332 bytes} [Mon May 16 15:07:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:24.577329 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-5e020761-4cb1-4296-b45b-a36d2269a6df admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:24.579658 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-5e020761-4cb1-4296-b45b-a36d2269a6df admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002407 May 16 15:07:24.580355 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:24.642657 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-9ad67449-ca85-4314-ab25-d69769b3a7dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:24.725120 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-9ad67449-ca85-4314-ab25-d69769b3a7dc admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.139186 May 16 15:07:24.725690 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 12/25] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:24.739573 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-1385cb2f-01ed-45ce-902e-859fdcbee0f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:24.828670 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-1385cb2f-01ed-45ce-902e-859fdcbee0f7 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094314 May 16 15:07:24.829532 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 14/26] 10.222.0.71 () {64 vars in 1332 bytes} [Mon May 16 15:07:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:27.287591 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-9ad67449-ca85-4314-ab25-d69769b3a7dc admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:27.288647 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-9ad67449-ca85-4314-ab25-d69769b3a7dc admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 16 15:07:27.289204 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 13/27] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:27.349119 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-cffe4d99-d2bb-4300-866f-962a813891ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "ram": 4096, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:27.430552 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-cffe4d99-d2bb-4300-866f-962a813891ca admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.135419 May 16 15:07:27.431097 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 15/28] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:27.443217 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-6d428f29-308e-4cd9-99d8-046cee4ef8c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:27.537619 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-6d428f29-308e-4cd9-99d8-046cee4ef8c2 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098078 May 16 15:07:27.538132 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 14/29] 10.222.0.71 () {64 vars in 1332 bytes} [Mon May 16 15:07:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:29.879529 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-cffe4d99-d2bb-4300-866f-962a813891ca admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:29.880587 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-cffe4d99-d2bb-4300-866f-962a813891ca admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 16 15:07:29.880990 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 16/30] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:29.958870 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-01bf81a1-f6f5-4831-9976-59218a9f62a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:30.025349 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-01bf81a1-f6f5-4831-9976-59218a9f62a2 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.138707 May 16 15:07:30.026383 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 15/31] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:30.039604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-e77f902a-77a1-412f-a1f0-4a5dc59b85b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:30.108181 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-e77f902a-77a1-412f-a1f0-4a5dc59b85b6 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072734 May 16 15:07:30.118506 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 17/32] 10.222.0.71 () {64 vars in 1332 bytes} [Mon May 16 15:07:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:32.592656 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-01bf81a1-f6f5-4831-9976-59218a9f62a2 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:32.594209 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-01bf81a1-f6f5-4831-9976-59218a9f62a2 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 May 16 15:07:32.594721 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 16/33] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:32.664579 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-580d98d6-838a-442e-a747-0287cc0b6a9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:32.790686 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-580d98d6-838a-442e-a747-0287cc0b6a9a admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.190010 May 16 15:07:32.791175 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 18/34] 10.222.0.71 () {64 vars in 1282 bytes} [Mon May 16 15:07:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:32.803643 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c7329c9e-0c09-43e9-bad2-7b2e554d5d36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:32.913748 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c7329c9e-0c09-43e9-bad2-7b2e554d5d36 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113866 May 16 15:07:32.914340 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 17/35] 10.222.0.71 () {64 vars in 1332 bytes} [Mon May 16 15:07:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:56.760613 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-580d98d6-838a-442e-a747-0287cc0b6a9a admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:56.761627 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-580d98d6-838a-442e-a747-0287cc0b6a9a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 16 15:07:56.762022 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 19/36] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:07:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:56.818599 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-5d6eda1d-53cd-4154-b692-ea09841fcd6a admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:56.836179 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-5d6eda1d-53cd-4154-b692-ea09841fcd6a admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067855 May 16 15:07:56.836808 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 18/37] 10.222.0.71 () {60 vars in 1291 bytes} [Mon May 16 15:07:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:07:57.849351 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-580d98d6-838a-442e-a747-0287cc0b6a9a admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:57.850344 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-580d98d6-838a-442e-a747-0287cc0b6a9a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 16 15:07:57.850739 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 20/38] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:07:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:58.046812 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-37e3b0c6-fa0c-4e5c-92ff-e4e27fae489f admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:58.052359 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-37e3b0c6-fa0c-4e5c-92ff-e4e27fae489f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-37e3b0c6-fa0c-4e5c-92ff-e4e27fae489f admin admin] Request method failure captured: May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Accept: application/json May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Accept-Encoding: gzip, deflate May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Connection: keep-alive May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Content-Length: 0 May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Host: 10.222.0.71 May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Openstack-Api-Version: compute 2.90 May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Openstack-System-Scope: None May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: User-Agent: python-novaclient May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Auth-Token: gAAAAABigmjNHPQreDFzDvK27VuT3S1RwL76rno49aP-K6mZxigoNUh0vyVJqgaLKPy3oyMO9Y4ub-Ql1_kS_hiMB0-00-UyL-wj11_6iTdSYqfzDQ43SyaHwrtjOfFDau5HPQ6yHWMdg7QCZ2kvCoZUDhtqACeHGM-5ZBETN4W9xXvSYfiQl1A May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Domain-Id: None May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Domain-Name: None May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Identity-Status: Confirmed May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Is-Admin-Project: True May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Domain-Id: default May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Domain-Name: Default May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Name: admin May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Role: admin,member,reader May 16 15:07:58.055587 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Roles: admin,member,reader May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_63e6523cee6045dabb771a1e00b70243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}] May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant: admin May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant-Name: admin May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User: admin May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Domain-Id: default May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Domain-Name: Default May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Id: 6246a26f46e94e7389a45ee846fec1c9 May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Name: admin May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: method: > May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: exception: Flavor 42 could not be found. May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: action_args: {'id': '42'} May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:58.057314 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:58.058455 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:58.059955 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-37e3b0c6-fa0c-4e5c-92ff-e4e27fae489f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:58.061260 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-37e3b0c6-fa0c-4e5c-92ff-e4e27fae489f admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060687 May 16 15:07:58.061260 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 19/39] 10.222.0.71 () {60 vars in 1190 bytes} [Mon May 16 15:07:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:07:58.067564 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-ceb76a26-9531-4f36-b8d6-2355f3ed115b admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:58.090269 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-ceb76a26-9531-4f36-b8d6-2355f3ed115b admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026212 May 16 15:07:58.090809 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 21/40] 10.222.0.71 () {60 vars in 1210 bytes} [Mon May 16 15:07:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:07:58.100559 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-02c8b060-f6ba-4c75-a2a0-76e6ea10ab54 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:58.121886 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-02c8b060-f6ba-4c75-a2a0-76e6ea10ab54 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024870 May 16 15:07:58.122420 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 20/41] 10.222.0.71 () {60 vars in 1210 bytes} [Mon May 16 15:07:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:07:58.132182 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-4a6b6b98-846c-407b-8a63-6505e5c9d85d admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:58.137584 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.wsgi [None req-4a6b6b98-846c-407b-8a63-6505e5c9d85d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-4a6b6b98-846c-407b-8a63-6505e5c9d85d admin admin] Request method failure captured: May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Accept: application/json May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Accept-Encoding: gzip, deflate May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Connection: keep-alive May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Content-Length: 0 May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Host: 10.222.0.71 May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Openstack-Api-Version: compute 2.90 May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Openstack-System-Scope: None May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: User-Agent: python-novaclient May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Auth-Token: gAAAAABigmjNHPQreDFzDvK27VuT3S1RwL76rno49aP-K6mZxigoNUh0vyVJqgaLKPy3oyMO9Y4ub-Ql1_kS_hiMB0-00-UyL-wj11_6iTdSYqfzDQ43SyaHwrtjOfFDau5HPQ6yHWMdg7QCZ2kvCoZUDhtqACeHGM-5ZBETN4W9xXvSYfiQl1A May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Domain-Id: None May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Domain-Name: None May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Identity-Status: Confirmed May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Is-Admin-Project: True May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Domain-Id: default May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Domain-Name: Default May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Name: admin May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Role: admin,member,reader May 16 15:07:58.140913 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Roles: admin,member,reader May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_63e6523cee6045dabb771a1e00b70243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}] May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant: admin May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant-Name: admin May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User: admin May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Domain-Id: default May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Domain-Name: Default May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Id: 6246a26f46e94e7389a45ee846fec1c9 May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Name: admin May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: method: > May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: exception: Flavor 42 could not be found. May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: action_args: {'id': '42'} May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:58.142411 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:58.143399 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:58.144718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-4a6b6b98-846c-407b-8a63-6505e5c9d85d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:58.145930 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-4a6b6b98-846c-407b-8a63-6505e5c9d85d admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013638 May 16 15:07:58.145930 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 22/42] 10.222.0.71 () {60 vars in 1190 bytes} [Mon May 16 15:07:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:07:59.046434 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-02c8b060-f6ba-4c75-a2a0-76e6ea10ab54 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:59.047426 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-02c8b060-f6ba-4c75-a2a0-76e6ea10ab54 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 16 15:07:59.047984 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 21/43] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:07:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:59.234787 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-046d07f4-60c2-4cb1-85c5-6d5e1ac4fee6 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:59.240125 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.wsgi [None req-046d07f4-60c2-4cb1-85c5-6d5e1ac4fee6 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-046d07f4-60c2-4cb1-85c5-6d5e1ac4fee6 admin admin] Request method failure captured: May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Accept: application/json May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Accept-Encoding: gzip, deflate May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Connection: keep-alive May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Content-Length: 0 May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Host: 10.222.0.71 May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Openstack-Api-Version: compute 2.90 May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Openstack-System-Scope: None May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: User-Agent: python-novaclient May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Auth-Token: gAAAAABigmjPPtawESilRTcd3HpYZE02pngsRADOhiN2HQJzy2O5OaNgdz-V1mDsBtEcbQiqg44KOlgD8vCmOtwgRsnv5VM3Mgec_NClnhGiY2RyFqChjy-24ttfiMI_gboUjl6skoj9Z2LvW5UTH6EIzxkyMfxUm4TDAS84YR5k8ZXk3ppJK-Y May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Domain-Id: None May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Domain-Name: None May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Identity-Status: Confirmed May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Is-Admin-Project: True May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Domain-Id: default May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Domain-Name: Default May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Name: admin May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Role: admin,member,reader May 16 15:07:59.241604 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Roles: admin,member,reader May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_63e6523cee6045dabb771a1e00b70243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}] May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant: admin May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant-Name: admin May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User: admin May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Domain-Id: default May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Domain-Name: Default May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Id: 6246a26f46e94e7389a45ee846fec1c9 May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Name: admin May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: method: > May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: exception: Flavor 84 could not be found. May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: action_args: {'id': '84'} May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:59.242905 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:59.243714 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:07:59.244797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-046d07f4-60c2-4cb1-85c5-6d5e1ac4fee6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:59.245839 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-046d07f4-60c2-4cb1-85c5-6d5e1ac4fee6 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059741 May 16 15:07:59.245839 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 23/44] 10.222.0.71 () {60 vars in 1190 bytes} [Mon May 16 15:07:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:07:59.252646 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-b8e173b5-7ca8-4403-8cc2-1b79d95779b2 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:59.266153 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-b8e173b5-7ca8-4403-8cc2-1b79d95779b2 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017028 May 16 15:07:59.266671 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 22/45] 10.222.0.71 () {60 vars in 1210 bytes} [Mon May 16 15:07:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:07:59.275911 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-08e4e705-9196-4edf-96d6-8b73c083f607 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:59.289927 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-08e4e705-9196-4edf-96d6-8b73c083f607 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017453 May 16 15:07:59.290693 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 24/46] 10.222.0.71 () {60 vars in 1210 bytes} [Mon May 16 15:07:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:07:59.300195 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-ace0d52d-1c9e-4a61-b4a1-c87655cde48e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:59.305356 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-ace0d52d-1c9e-4a61-b4a1-c87655cde48e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-ace0d52d-1c9e-4a61-b4a1-c87655cde48e admin admin] Request method failure captured: May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Accept: application/json May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Accept-Encoding: gzip, deflate May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Connection: keep-alive May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Content-Length: 0 May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Host: 10.222.0.71 May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Openstack-Api-Version: compute 2.90 May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Openstack-System-Scope: None May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: User-Agent: python-novaclient May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Auth-Token: gAAAAABigmjPPtawESilRTcd3HpYZE02pngsRADOhiN2HQJzy2O5OaNgdz-V1mDsBtEcbQiqg44KOlgD8vCmOtwgRsnv5VM3Mgec_NClnhGiY2RyFqChjy-24ttfiMI_gboUjl6skoj9Z2LvW5UTH6EIzxkyMfxUm4TDAS84YR5k8ZXk3ppJK-Y May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Domain-Id: None May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Domain-Name: None May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Identity-Status: Confirmed May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Is-Admin-Project: True May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Domain-Id: default May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Domain-Name: Default May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Name: admin May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Role: admin,member,reader May 16 15:07:59.306820 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Roles: admin,member,reader May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_63e6523cee6045dabb771a1e00b70243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}] May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant: admin May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant-Name: admin May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User: admin May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Domain-Id: default May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Domain-Name: Default May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Id: 6246a26f46e94e7389a45ee846fec1c9 May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Name: admin May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: method: > May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: exception: Flavor 84 could not be found. May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: action_args: {'id': '84'} May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:59.308384 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:59.313621 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:07:59.314874 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-ace0d52d-1c9e-4a61-b4a1-c87655cde48e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:59.316165 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-ace0d52d-1c9e-4a61-b4a1-c87655cde48e admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011422 May 16 15:07:59.316165 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 23/47] 10.222.0.71 () {60 vars in 1190 bytes} [Mon May 16 15:07:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 16 15:08:00.189938 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-08e4e705-9196-4edf-96d6-8b73c083f607 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:00.190909 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-08e4e705-9196-4edf-96d6-8b73c083f607 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 16 15:08:00.191295 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 25/48] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:08:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:08:00.378265 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-6ac47b90-13bb-4442-a1f1-a2e2c170e1dd admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:00.383918 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-6ac47b90-13bb-4442-a1f1-a2e2c170e1dd admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-6ac47b90-13bb-4442-a1f1-a2e2c170e1dd admin admin] Request method failure captured: May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Accept: application/json May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Accept-Encoding: gzip, deflate May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Connection: keep-alive May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Content-Length: 0 May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Host: 10.222.0.71 May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Openstack-Api-Version: compute 2.90 May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Openstack-System-Scope: None May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: User-Agent: python-novaclient May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Auth-Token: gAAAAABigmjQ27D8dBFBWrITycGFaVuClXmC4qPZDqrnE7pbls-nmRSu5aaIyd_RSOG5gTNvZCNiqK7bd7TYgyNri9RLelhAlwK41ss8pR5AXNEUqk-5JrXfMqnvI2ghMNp_JXBSFif45TNdo7WnVib5IY1IjcIjFd2e6xTkpUW-CL_sbfqi_3s May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Domain-Id: None May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Domain-Name: None May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Identity-Status: Confirmed May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Is-Admin-Project: True May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Domain-Id: default May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Domain-Name: Default May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Project-Name: admin May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Role: admin,member,reader May 16 15:08:00.385399 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Roles: admin,member,reader May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_63e6523cee6045dabb771a1e00b70243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}] May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant: admin May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-Tenant-Name: admin May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User: admin May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Domain-Id: default May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Domain-Name: Default May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Id: 6246a26f46e94e7389a45ee846fec1c9 May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: X-User-Name: admin May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: method: > May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: exception: Flavor 451 could not be found. May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: action_args: {'id': '451'} May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:08:00.386934 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:08:00.387948 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi May 16 15:08:00.389824 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-6ac47b90-13bb-4442-a1f1-a2e2c170e1dd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:08:00.391265 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-6ac47b90-13bb-4442-a1f1-a2e2c170e1dd admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057815 May 16 15:08:00.391265 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 24/49] 10.222.0.71 () {60 vars in 1193 bytes} [Mon May 16 15:08:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:08:00.397122 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-8902dd09-7d1f-4c7c-9111-ecc3739c7dd4 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:00.411254 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-8902dd09-7d1f-4c7c-9111-ecc3739c7dd4 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017677 May 16 15:08:00.411728 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 26/50] 10.222.0.71 () {60 vars in 1210 bytes} [Mon May 16 15:08:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:08:00.421196 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:00.434456 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016710 May 16 15:08:00.434968 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 25/51] 10.222.0.71 () {60 vars in 1210 bytes} [Mon May 16 15:08:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:08:00.443720 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-a9e94834-88cf-43f8-a691-a6852da4c596 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:00.448797 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.wsgi [None req-a9e94834-88cf-43f8-a691-a6852da4c596 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-a9e94834-88cf-43f8-a691-a6852da4c596 admin admin] Request method failure captured: May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Accept: application/json May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Accept-Encoding: gzip, deflate May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Connection: keep-alive May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Content-Length: 0 May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Host: 10.222.0.71 May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Openstack-Api-Version: compute 2.90 May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Openstack-System-Scope: None May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: User-Agent: python-novaclient May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Auth-Token: gAAAAABigmjQ27D8dBFBWrITycGFaVuClXmC4qPZDqrnE7pbls-nmRSu5aaIyd_RSOG5gTNvZCNiqK7bd7TYgyNri9RLelhAlwK41ss8pR5AXNEUqk-5JrXfMqnvI2ghMNp_JXBSFif45TNdo7WnVib5IY1IjcIjFd2e6xTkpUW-CL_sbfqi_3s May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Domain-Id: None May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Domain-Name: None May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Identity-Status: Confirmed May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Is-Admin-Project: True May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Domain-Id: default May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Domain-Name: Default May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Project-Name: admin May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Role: admin,member,reader May 16 15:08:00.450249 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Roles: admin,member,reader May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/63e6523cee6045dabb771a1e00b70243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_63e6523cee6045dabb771a1e00b70243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/63e6523cee6045dabb771a1e00b70243"}]}] May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant: admin May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant-Id: 63e6523cee6045dabb771a1e00b70243 May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-Tenant-Name: admin May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User: admin May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Domain-Id: default May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Domain-Name: Default May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Id: 6246a26f46e94e7389a45ee846fec1c9 May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: X-User-Name: admin May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: method: > May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: exception: Flavor 451 could not be found. May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: action_args: {'id': '451'} May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:08:00.452348 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:08:00.454112 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: ERROR nova.api.openstack.wsgi May 16 15:08:00.455487 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-a9e94834-88cf-43f8-a691-a6852da4c596 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:08:00.456718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-a9e94834-88cf-43f8-a691-a6852da4c596 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011265 May 16 15:08:00.456718 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 27/52] 10.222.0.71 () {60 vars in 1193 bytes} [Mon May 16 15:08:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 16 15:08:01.348637 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:01.349627 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 16 15:08:01.350020 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:08:01.536767 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-3bb241c0-4c12-440b-a5a4-8761bdd03931 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:08:01.637671 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-3bb241c0-4c12-440b-a5a4-8761bdd03931 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.151223 May 16 15:08:01.638168 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 28/54] 10.222.0.71 () {64 vars in 1235 bytes} [Mon May 16 15:08:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:08:02.537841 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:02.538840 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 16 15:08:02.539236 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:08:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:08:02.725866 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-69436935-1bb1-45f5-a917-f4f259cecd29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:08:02.815235 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-69436935-1bb1-45f5-a917-f4f259cecd29 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.138801 May 16 15:08:02.815724 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 29/56] 10.222.0.71 () {64 vars in 1235 bytes} [Mon May 16 15:08:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:08:03.719078 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:03.720114 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 16 15:08:03.721550 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 28/57] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:08:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:08:03.907876 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-d28252f5-e0f0-4397-8849-7b8285aa3a04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:08:04.040935 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-d28252f5-e0f0-4397-8849-7b8285aa3a04 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.183867 May 16 15:08:04.041478 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 30/58] 10.222.0.71 () {64 vars in 1235 bytes} [Mon May 16 15:08:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:08:04.938931 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:04.939964 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 May 16 15:08:04.940361 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 29/59] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:08:05.128336 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-52b44026-060c-4d10-b21b-09db55c63c70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:08:05.227184 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-52b44026-060c-4d10-b21b-09db55c63c70 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.148915 May 16 15:08:05.227746 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 31/60] 10.222.0.71 () {64 vars in 1235 bytes} [Mon May 16 15:08:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:08:06.129907 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:06.130894 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 16 15:08:06.131288 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 30/61] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:08:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:08:06.316171 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-c8be55cd-1ed7-4cfa-847a-3dde873eb9b6 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:08:06.335752 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-c8be55cd-1ed7-4cfa-847a-3dde873eb9b6 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070119 May 16 15:08:06.336288 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 32/62] 10.222.0.71 () {60 vars in 1202 bytes} [Mon May 16 15:08:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:09:09.199951 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:09.200954 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-66c8ab1d-e5db-4e09-b605-a5ccbfad89fb admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 16 15:09:09.201359 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 31/63] 10.222.0.71 () {54 vars in 930 bytes} [Mon May 16 15:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:09:09.257873 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-88a7de06-7777-40b1-a1db-a0a9c36f7a78 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:09.277216 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-88a7de06-7777-40b1-a1db-a0a9c36f7a78 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070146 May 16 15:09:09.277738 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 33/64] 10.222.0.71 () {60 vars in 1291 bytes} [Mon May 16 15:09:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:09:09.300303 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-19e785fe-60d0-444e-a605-bf8f176f1212 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:09.307876 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-19e785fe-60d0-444e-a605-bf8f176f1212 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011674 May 16 15:09:09.308390 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 32/65] 10.222.0.71 () {60 vars in 1282 bytes} [Mon May 16 15:09:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:09:09.319243 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-fe52e33d-ccbe-42f3-a81d-f0da17b6ec12 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:09.327204 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-fe52e33d-ccbe-42f3-a81d-f0da17b6ec12 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011383 May 16 15:09:09.327757 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 34/66] 10.222.0.71 () {60 vars in 1285 bytes} [Mon May 16 15:09:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:09:09.339294 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:09.346845 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011741 May 16 15:09:09.347360 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 33/67] 10.222.0.71 () {60 vars in 1285 bytes} [Mon May 16 15:09:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:09:09.358370 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-f1cc173b-02bf-4389-8d72-3f3f764c9410 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:09.365881 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-f1cc173b-02bf-4389-8d72-3f3f764c9410 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011045 May 16 15:09:09.369643 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 35/68] 10.222.0.71 () {60 vars in 1282 bytes} [Mon May 16 15:09:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:05.552319 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:05.553327 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 16 15:13:05.553731 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 34/69] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:13:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:05.816324 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-ab9d9c62-645a-4515-bee3-52cc0cb91b72 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:05.817475 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:05.817475 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: warnings.warn(msg) May 16 15:13:05.818657 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-ab9d9c62-645a-4515-bee3-52cc0cb91b72 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:05.819085 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-ab9d9c62-645a-4515-bee3-52cc0cb91b72 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:05.819880 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-ab9d9c62-645a-4515-bee3-52cc0cb91b72 admin admin] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:05.820298 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-ab9d9c62-645a-4515-bee3-52cc0cb91b72 admin admin] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:05.853644 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-ab9d9c62-645a-4515-bee3-52cc0cb91b72 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146062 May 16 15:13:05.854196 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 36/70] 10.222.0.71 () {60 vars in 1193 bytes} [Mon May 16 15:13:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:06.741771 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:06.742765 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 May 16 15:13:06.743157 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 35/71] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:13:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:06.932032 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-2dec6e59-9bc0-4e42-a40f-84597c8befed admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:06.933228 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:06.933228 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: warnings.warn(msg) May 16 15:13:06.934398 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-2dec6e59-9bc0-4e42-a40f-84597c8befed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:06.934853 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-2dec6e59-9bc0-4e42-a40f-84597c8befed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:06.935660 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-2dec6e59-9bc0-4e42-a40f-84597c8befed admin admin] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:06.936081 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-2dec6e59-9bc0-4e42-a40f-84597c8befed admin admin] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:06.954685 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-2dec6e59-9bc0-4e42-a40f-84597c8befed admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074476 May 16 15:13:06.955227 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 37/72] 10.222.0.71 () {60 vars in 1193 bytes} [Mon May 16 15:13:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:13:18.281906 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:18.282930 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 16 15:13:18.283324 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 36/73] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:13:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:18.472780 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-a07c5bac-d177-4e07-926e-437c06fcec59 admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:18.473983 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:18.473983 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: warnings.warn(msg) May 16 15:13:18.475160 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-a07c5bac-d177-4e07-926e-437c06fcec59 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:18.475596 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-a07c5bac-d177-4e07-926e-437c06fcec59 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:18.476427 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-a07c5bac-d177-4e07-926e-437c06fcec59 admin admin] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:18.476872 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-a07c5bac-d177-4e07-926e-437c06fcec59 admin admin] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:18.501279 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-a07c5bac-d177-4e07-926e-437c06fcec59 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079618 May 16 15:13:18.501771 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 38/74] 10.222.0.71 () {60 vars in 1193 bytes} [Mon May 16 15:13:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:13:19.397421 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:19.398524 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c4bf4556-21c9-4c0d-ba2f-dfb9e7aca9ca admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 16 15:13:19.407072 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 37/75] 10.222.0.71 () {56 vars in 1074 bytes} [Mon May 16 15:13:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:19.590644 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG nova.api.openstack.wsgi [None req-391040f3-83b8-40bd-9cd5-e317f6a800aa admin admin] Calling method '>' {{(pid=103290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:19.591897 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:19.591897 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: warnings.warn(msg) May 16 15:13:19.593059 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-391040f3-83b8-40bd-9cd5-e317f6a800aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:19.593488 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-391040f3-83b8-40bd-9cd5-e317f6a800aa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:19.594290 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-391040f3-83b8-40bd-9cd5-e317f6a800aa admin admin] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:19.594708 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: DEBUG oslo_concurrency.lockutils [None req-391040f3-83b8-40bd-9cd5-e317f6a800aa admin admin] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:19.617956 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: INFO nova.api.openstack.requestlog [None req-391040f3-83b8-40bd-9cd5-e317f6a800aa admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078806 May 16 15:13:19.618428 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: [pid: 103290|app: 0|req: 39/76] 10.222.0.71 () {60 vars in 1193 bytes} [Mon May 16 15:13:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:14:20.235153 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: Mon May 16 15:14:20 2022 - graceful shutdown triggered... May 16 15:14:20.235712 dv-cinder-841753-2-iscsi devstack@n-api.service[103290]: Gracefully killing worker 2 (pid: 103290)... May 16 15:14:20.235279 dv-cinder-841753-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 15:14:20.236557 dv-cinder-841753-2-iscsi devstack@n-api.service[103289]: Gracefully killing worker 1 (pid: 103289)... May 16 15:14:21.236282 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: worker 1 buried after 1 seconds May 16 15:14:21.236807 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: worker 2 buried after 1 seconds May 16 15:14:21.236807 dv-cinder-841753-2-iscsi devstack@n-api.service[103288]: goodbye to uWSGI. May 16 15:14:21.237799 dv-cinder-841753-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 15:14:21.238396 dv-cinder-841753-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 15:14:21.241165 dv-cinder-841753-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 15:14:21.256974 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 15:14:21 2022] *** May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: nodename: dv-cinder-841753-2-iscsi May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: machine: x86_64 May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: clock source: unix May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: pcre jit disabled May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: detected number of CPU cores: 4 May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: current working directory: / May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: detected binary path: /usr/bin/uwsgi-core May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: your processes number limit is 47680 May 16 15:14:21.275582 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: your memory page size is 4096 bytes May 16 15:14:21.276663 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: detected max file descriptor number: 2048 May 16 15:14:21.276663 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: lock engine: pthread robust mutexes May 16 15:14:21.276663 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: thunder lock: enabled May 16 15:14:21.276663 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 15:14:21.276663 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 15:14:21.322014 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: Python main interpreter initialized at 0x560a3e8679c0 May 16 15:14:21.322014 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: python threads support enabled May 16 15:14:21.322014 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: your server socket listen backlog is limited to 100 connections May 16 15:14:21.322014 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: your mercy for graceful operations on workers is 90 seconds May 16 15:14:21.322469 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: mapped 403077 bytes (393 KB) for 2 cores May 16 15:14:21.322469 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: *** Operational MODE: preforking *** May 16 15:14:21.322715 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: *** uWSGI is running in multiple interpreter mode *** May 16 15:14:21.322715 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: spawned uWSGI master process (pid: 117656) May 16 15:14:21.322923 dv-cinder-841753-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 15:14:21.323655 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: spawned uWSGI worker 1 (pid: 117676, cores: 1) May 16 15:14:21.324516 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: spawned uWSGI worker 2 (pid: 117677, cores: 1) May 16 15:14:21.324516 dv-cinder-841753-2-iscsi devstack@n-api.service[117656]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 15:14:22.540734 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:14:22.541368 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:14:23.350463 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:14:23.350463 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: from cryptography.utils import int_from_bytes May 16 15:14:23.350772 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:14:23.350772 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: from cryptography.utils import int_from_bytes May 16 15:14:23.354422 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:14:23.354422 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: from cryptography.utils import int_from_bytes May 16 15:14:23.354733 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:14:23.354733 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: from cryptography.utils import int_from_bytes May 16 15:14:25.796351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:14:25.796893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:14:25.796985 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:14:25.796985 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:14:25.797415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:14:25.797499 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:14:25.797583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:14:25.797668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:14:25.797745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:14:25.798098 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:14:25.798216 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.798301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.798406 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.798624 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.798734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.798948 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.799068 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.799269 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.799378 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.799582 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.799779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.799943 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.800047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.800243 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.800351 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.800561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.800695 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.800884 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.801007 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.801180 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.801297 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.801482 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.801664 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841753-2-iscsi {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.801819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841753-2-iscsi {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.801973 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.802120 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.802271 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.802418 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.802578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.802731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.802887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.803040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.803195 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.803343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.803503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.804365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.804534 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.804534 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.806121 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.806380 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.806651 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.806869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.807080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.807302 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.807526 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.807780 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.807998 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.808217 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.808432 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.808639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.808917 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.809136 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.809362 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.809578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.809797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.810010 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.810237 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.810456 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.810661 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.810869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.811105 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841753-2-iscsi {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.811330 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841753-2-iscsi {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.811508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.811730 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.811924 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.812090 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.812291 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.813000 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.813161 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.813321 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.813476 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.813630 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.813804 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.814221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.814401 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.814555 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.814705 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.814875 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.815029 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.815182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.815332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.815476 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.815654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.815821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.815975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.816128 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.816282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.816434 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.817531 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.817695 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.817849 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.818003 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.818162 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.818314 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.818458 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.818600 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.818750 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.818894 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.819050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.819196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.819344 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.819486 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.819680 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.819841 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.820002 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.820157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.820311 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.820455 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.820596 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.820827 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.820985 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.821139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.821285 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.821440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.821594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.821745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.821899 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.822043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.822201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.822345 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.822524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.823285 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.823447 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.823610 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.823787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.823944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.824395 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.824555 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.824707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.824858 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.825010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.825161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.825314 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.825469 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.825613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.825762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.825913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.826087 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.826239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.826390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.826545 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.826688 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.826846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.827016 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.827161 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.827161 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.827432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.827432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.827854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.828018 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.828183 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.828340 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.828711 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.828864 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.829007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.829161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.829305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.829447 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.829597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.830076 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.830247 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.830446 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.830620 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.830779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.830929 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.831079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.831239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.831390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.831533 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.831705 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.831855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.831855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.832153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.832153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.832443 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.832595 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.832745 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.833394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.833571 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.833725 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.833878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.834022 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.834266 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.834639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.834803 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.834957 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.835107 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.835251 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.835414 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.835566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.835754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.835901 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.836051 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.836202 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.836351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.836504 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.836654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.836802 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.836957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.837099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.837252 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.837414 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.837564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.837714 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.837857 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.838006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.838158 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.838317 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.838468 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.838611 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.838760 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.838912 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.839070 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.839213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.845488 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.846278 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.846448 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.846612 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.846774 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.846928 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.847079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.847229 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.847380 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.847380 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.847694 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.847845 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.847845 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.848142 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.848293 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.848977 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.848977 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.849328 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.849472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.849627 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.849776 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.849933 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.850084 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.850227 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.850368 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.850528 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.850672 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.850829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.850978 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.851135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.851285 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.851429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.851571 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.851877 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.852035 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.852196 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.852449 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.852705 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.852878 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.853030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.853181 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.853331 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.853484 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.853636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.854133 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.854297 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.854450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.854601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.854751 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.854902 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.855056 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.855555 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.855743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.855898 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.856050 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.856200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.856353 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.856552 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.856710 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.856856 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.856998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.857149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857299 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857460 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857604 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857895 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858055 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858366 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858659 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858809 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859036 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859188 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859502 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859674 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859987 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860130 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860272 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860421 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860571 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860728 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860872 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861028 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861338 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862106 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862247 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862539 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862980 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863120 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863283 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863591 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863758 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.864936 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.865099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.865099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.865861 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866018 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866323 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866789 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866932 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867081 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867699 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867851 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868002 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868146 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868299 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868443 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868749 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868899 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869196 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869355 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869500 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870098 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870255 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870399 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870551 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870705 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870848 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870996 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871304 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871454 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871606 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872611 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873093 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873392 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873536 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873695 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874024 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874564 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874883 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875223 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875949 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876114 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876268 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876421 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876714 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876858 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877162 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877468 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877971 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878132 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878294 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878439 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878580 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879016 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879167 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879856 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881099 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881251 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881565 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881717 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881867 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882170 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882312 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882462 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882764 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882920 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883064 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883207 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883853 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884009 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884436 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884664 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885242 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885401 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885544 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885705 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886117 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886270 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886554 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886721 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886990 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.887149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.887293 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.887443 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.887593 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.887781 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.887990 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.888236 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.888236 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.888489 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.888608 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.888720 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.888830 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.888954 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.889065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.889181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.889298 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.889410 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.889533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.889645 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.889753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890006 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890134 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890246 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890364 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890484 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890601 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890712 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890828 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.890944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.891068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.891179 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.891287 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.891403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.891515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.891679 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904980 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905062 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905410 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905670 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905760 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905852 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905936 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906268 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906339 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906409 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906652 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906794 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906864 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907041 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907122 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907122 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907267 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907339 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907427 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907507 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907744 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907833 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907921 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.907993 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908063 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908132 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908202 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908672 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908750 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908831 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908910 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909296 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909455 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909530 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909762 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909832 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909980 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910207 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910277 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910354 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910431 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910665 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910744 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910821 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910892 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.911488 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.911576 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.911685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.911774 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.911854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.911948 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912536 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912652 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912777 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912896 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913014 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913131 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913242 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913351 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913469 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913588 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913806 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913921 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914158 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914269 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914389 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914607 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914723 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914847 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914960 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915069 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915411 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915536 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915687 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915929 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916153 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916299 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916412 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916520 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916746 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916868 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916987 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917105 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917222 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917460 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917696 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918273 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918502 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918502 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918715 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918715 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.918939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919104 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919220 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919330 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919559 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919839 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919950 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920057 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920299 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920670 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920787 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920787 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920977 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921131 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921219 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921302 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921468 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921592 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921827 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921921 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922098 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922283 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922499 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922617 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922793 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.922933 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923026 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923026 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923195 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923469 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923929 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924108 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924283 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924366 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924462 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924548 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924725 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924815 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.925042 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.925130 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.925224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.925323 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.925445 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.925554 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.926054 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.926155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.926241 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.926332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.926417 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.926499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.926630 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.927301 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.927415 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.927519 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.927667 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.927797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.927904 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.927985 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928076 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928161 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928252 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928344 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928442 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928527 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928618 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928794 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928896 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.928982 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929066 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929277 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929371 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929469 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929555 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929649 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929835 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.929965 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930068 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930169 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930255 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930342 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930342 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930480 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930787 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930865 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.930951 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931109 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931109 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931408 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931552 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931750 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931846 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.931939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932028 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932121 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932195 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932277 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932349 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932419 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932504 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932662 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932810 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.932992 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933083 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933169 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933252 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933371 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933477 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933564 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933831 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.933915 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934042 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934263 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934380 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934481 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934574 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934843 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.934928 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.935019 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.935149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.935236 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.935326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.935422 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.935523 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.935523 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.938507 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.938757 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.938849 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.938934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939118 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939218 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939377 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939456 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939542 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939542 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.939922 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940230 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940414 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940547 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940802 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.940913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941022 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941114 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941199 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941199 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941372 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941458 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941548 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941640 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941732 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941825 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941825 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.941997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942090 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942278 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942438 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942526 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942683 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942683 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.942939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943063 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943156 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943249 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943323 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943393 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943486 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943811 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943907 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.943993 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944085 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944261 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944347 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944431 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944431 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944689 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.944948 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945132 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945216 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945308 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945394 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945478 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945666 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945666 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945811 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.945987 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946259 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946345 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946437 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946437 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946765 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946857 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.946943 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947213 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947300 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947383 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947467 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947658 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947759 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947854 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.947947 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948201 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948298 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948392 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948479 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948647 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948738 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948837 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.948923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949006 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949096 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949278 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949492 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949702 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949794 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949888 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.949982 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950075 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950208 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950496 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950589 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950763 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950835 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950906 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.950986 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951097 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951177 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951248 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951319 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951399 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951479 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951552 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951711 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951881 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.951959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952058 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952140 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952233 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952318 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952582 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952887 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.952981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953062 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953291 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953643 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953767 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.953998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954128 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954225 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954311 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954404 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954497 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954580 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954652 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954728 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954807 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954888 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.954961 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955031 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955179 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955537 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955718 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955793 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955870 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.955943 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.956020 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.956093 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.956172 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.957121 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.957277 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.957534 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.957642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.957737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.957894 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.958048 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.958149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.958149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.958149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.958478 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.958781 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.958878 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.959140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.959243 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.959673 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.959796 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.959886 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.960115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.960245 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.960330 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.960494 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.960893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.961039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.961140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.961239 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.961408 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.961515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.961744 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.961843 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.962079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.962189 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.962412 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.962516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.962729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.962822 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.963095 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.963198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.963407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.963518 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.963759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.963864 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.964083 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.964187 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.964400 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.964502 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.964724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.964818 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.965035 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.965136 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.965366 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.965469 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.965697 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.965790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.966018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.966125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.966344 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.966444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.966664 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.966756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.966970 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.967077 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.967282 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.967375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.967649 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.967758 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.967965 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.968069 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.968291 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.968396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.968598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.968691 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.968911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.969012 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.969221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.969314 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.969533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.969668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.969837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.970003 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.970140 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.970315 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.970465 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.970631 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.970784 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.970952 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.971091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.971260 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.971386 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.971570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.971728 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.971901 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.972047 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.972227 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.972354 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.972535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.972681 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.972879 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.972984 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.973178 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.973280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.974059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.974194 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.974572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.974679 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.974855 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.974952 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.975161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.975272 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.975484 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.975591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.975817 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.975913 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.976129 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.976226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.976439 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.976535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.976788 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.976961 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.977096 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.977192 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.977418 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.977512 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.977738 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.977843 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.978065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.978158 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.978369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.978462 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.978672 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.978776 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.978986 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.979079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.979327 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.979441 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.979723 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.979865 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.980109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.980215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.980393 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.980558 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.980703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.980952 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.981259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.981524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.981799 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.981893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.982115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.982219 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.982428 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.982524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.982733 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.982829 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.983039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.983142 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.983346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.983441 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.983690 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.985954 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986060 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986143 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986227 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986818 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.986901 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.987170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.987528 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.987868 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.988194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.988513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.988829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.989741 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.990218 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.990359 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.990676 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.991007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.991379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.995567 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.995567 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.995945 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.996107 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.996275 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.996275 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.996579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.996579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.996901 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.997057 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.997220 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.997439 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.997594 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.997746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.997898 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.998049 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.998221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.998384 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.998547 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.998707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.998861 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.999080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.999250 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.999412 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.999592 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.999782 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.999946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.000109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.000290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.000514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.000675 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.000836 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.000998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.001248 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.001248 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.001775 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.001962 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.002126 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.002286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.002450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.002604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.002604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.002898 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.003049 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.003221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.003375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.003527 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.003696 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.003877 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.004040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.004203 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.004372 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.004533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.005090 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.005290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.005469 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.005635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.005798 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.005798 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.006097 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.006251 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.006430 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.006592 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.006752 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.006914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.007074 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.007227 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.007388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.007542 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.007712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.007872 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.008037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.008205 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.008376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.008530 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.008681 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.008842 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.008996 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.009246 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.009407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.009567 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.009720 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.009890 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.010051 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.010215 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.010379 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.010548 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.010781 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.010947 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.011116 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.011270 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.011429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.011711 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.012014 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.012176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.012344 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.012498 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.012662 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.012822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.012975 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.013144 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.013144 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.013454 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.013607 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.013758 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.013917 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.014078 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.014239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.014399 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.014552 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.014723 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.014893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.015169 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.015416 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.015582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.015582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.015917 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.015917 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.016224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.016379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.016538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.016699 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.016699 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.017001 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.017164 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.017327 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.017487 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.017648 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.017809 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.017971 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.018140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.018293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.018446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.018604 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.018756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.018932 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.019092 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.019270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.019491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.019678 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.019839 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.020005 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.020165 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.020342 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.020502 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.020502 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.020888 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.021057 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.021234 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.021387 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.021547 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.021781 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.022091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.022254 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.022413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.022576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.022730 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.023151 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.023370 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.023524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.023524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.023851 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024004 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024155 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024318 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024471 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024638 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024638 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.024937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.026046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.026214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.026375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.026536 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.026689 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.026849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.027003 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.027003 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.027324 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.027477 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.027706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.027869 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.028033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.028198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.028359 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.028512 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.028663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.028813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.028965 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.029126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.029293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.029470 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.029698 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.029858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.030024 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.030196 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.030349 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.030508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.030661 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.030820 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.031068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.031235 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.031388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.031388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.031693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.031944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.032255 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.032423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.032588 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.032740 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.032891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.033058 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.033299 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.033455 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.033613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.033766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.033917 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.034079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.034239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.034399 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.034576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.034730 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.034881 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.035043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.035205 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.035375 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.035660 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.036419 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.036648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.036821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.036985 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.036985 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.037288 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.037460 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.037623 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.037776 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.037928 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.038079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.038230 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.038391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.038554 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.038707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.038866 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.039018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.039169 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.039332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.039503 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.039693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.039926 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.040085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.040236 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.040396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.040396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.040706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.040867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.041036 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.041260 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.041432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.041597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.041750 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.041920 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.042295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.042462 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.042462 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.042812 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.042812 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.043122 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.043122 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.043422 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.043589 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.043787 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.043787 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.044089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.044250 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.044416 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.044570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.044722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.044881 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.045034 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.045192 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.045354 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.045514 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.045770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.045963 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.046211 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.046424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.046597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.046752 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.046752 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.047058 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.047058 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.047370 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.047523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.047703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.047862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.048026 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.048186 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.048348 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.048501 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.048659 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.048812 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.048974 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.049133 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.049298 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.049451 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.049609 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.049769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.049947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.050177 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.050346 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.050508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.050668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.050823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.050984 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.051146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.051382 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.051564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.051564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.051973 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.052151 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.052530 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.052691 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.052850 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.053009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.053174 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.053333 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.053497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.053650 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.053819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.054052 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.054052 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.054363 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.054524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.054691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.054843 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.054995 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.055200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.055368 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.055529 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.055730 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.055899 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.056077 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.056405 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.056581 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.056736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.056736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.057037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.057198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.057364 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.057517 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.057677 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.057829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.057988 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.058140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.058306 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.058459 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.058610 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.058770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.058933 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.059091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.059260 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.059414 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.059565 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.059741 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.059905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.060064 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.060309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.060492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.060646 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.060797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.060948 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.061123 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.061123 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.061517 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.061684 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.061838 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.061989 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.062149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.062301 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.062653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.062814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.062972 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.063129 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.063303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.063459 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.063659 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.063822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.063986 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.064146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.064313 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.064466 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.064619 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.064784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.064784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.065150 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.065305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.065468 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.065628 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.065789 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.065941 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.066102 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.066254 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.066605 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.066775 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.066928 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.067079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.067789 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.067958 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.068124 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.068284 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.068438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.068603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.068764 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.068924 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.069076 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.069227 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.069227 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.069525 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.069685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.069838 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.069989 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.070157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.070327 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.070568 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.070736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.070898 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.071051 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.071203 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.071362 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.071546 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.071791 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.071954 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.072106 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.072258 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.072441 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.072827 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073368 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:14:26.073529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.073529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.074704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.074704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.074704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.074704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.074704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.074704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.074704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.074704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.075923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.075923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.075923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.075923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.075923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.075923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.075923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.075923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.077333 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.077333 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.077333 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.077333 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:26.077333 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:14:26.090894 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_db.sqlalchemy.engines [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.100876 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_db.sqlalchemy.engines [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.158818 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.context [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0d3babb-5d7b-45d9-bcb1-3c089af1ca15(cell1) {{(pid=117676) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:14:26.163538 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:14:26.165158 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:14:26.165996 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:14:26.167842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.context [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0d3babb-5d7b-45d9-bcb1-3c089af1ca15(cell1) {{(pid=117677) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:14:26.168047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:14:26.172373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:14:26.174069 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:14:26.174916 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:14:26.177072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:14:26.179313 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_db.sqlalchemy.engines [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.182860 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_db.sqlalchemy.engines [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.188671 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_db.sqlalchemy.engines [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.200601 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_db.sqlalchemy.engines [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.343566 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_db.sqlalchemy.engines [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.358426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_db.sqlalchemy.engines [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.661730 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: WARNING keystonemiddleware.auth_token [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:14:26.669188 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: WARNING keystonemiddleware.auth_token [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:14:26.676424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: WARNING keystonemiddleware.auth_token [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:14:26.684179 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: WARNING keystonemiddleware.auth_token [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:14:27.013092 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: WARNING keystonemiddleware.auth_token [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:14:27.019251 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: WARNING keystonemiddleware.auth_token [None req-2e13e85c-16dc-4f14-bd9c-e8345c64e5d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:14:27.025723 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a3e8679c0 pid: 117676 (default app) May 16 15:14:27.030736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: WARNING keystonemiddleware.auth_token [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:14:27.037209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: WARNING keystonemiddleware.auth_token [None req-63b40863-be71-47d9-90b0-b23ea49037fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:14:27.042308 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a3e8679c0 pid: 117677 (default app) May 16 15:15:10.502310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1495f34d-a327-4278-a1eb-e33ccf0409b1 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Action: 'create', calling method: .version_select at 0x7f0c897fa280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1410725824", "metadata": {"Type": "work"}}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:10.729825 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ad0436ef-1ae9-4d96-b254-f39a76139568 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Action: 'create', calling method: .version_select at 0x7f0c897f8280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1316360020", "metadata": {"Type": "work"}}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ad0436ef-1ae9-4d96-b254-f39a76139568 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Request method failure captured: May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 122 May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmp9T7EGPNIdNKH_X0raPRRwOpZpJU9ahM1v-so4EuOg2DrIHNA_WJu_lJZOKAbm8aBBe0r3TrJNiTguzbtLjZQr8Md6VdccOptQP0fjYy0spVfJYNpQEmp-cwMMNV6SPcce4CW1M_YVkw-ocyEo8L8KrxtkH2T1m06IqHnQr9DKg4k May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:15:10.749002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d45888465c0f408a903d88d15bff69f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}] May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-VolumesNegativeTest-1843091239 May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 8d4bbcec028b48e0ace0d2fe12ff5b49 May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1316360020", "metadata": {"Type": "work"}}} May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: May 16 15:15:10.750755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1316360020', 'metadata': {'Type': 'work'}}}} May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise error May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi '#$%' May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:10.751842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:15:10.753440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:15:10.755215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:15:10.755215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:10.755215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ad0436ef-1ae9-4d96-b254-f39a76139568 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:10.755215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ad0436ef-1ae9-4d96-b254-f39a76139568 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.377056 May 16 15:15:10.756632 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 1/1] 10.222.0.71 () {60 vars in 1155 bytes} [Mon May 16 15:15:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1384 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:15:10.946209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-af76561e-782e-4523-8eb3-87f62ead2eaf tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Action: 'create', calling method: .version_select at 0x7f0c8a027700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1122725888"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:12.474675 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1495f34d-a327-4278-a1eb-e33ccf0409b1 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.126551 May 16 15:15:12.475388 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 1/2] 10.222.0.71 () {60 vars in 1155 bytes} [Mon May 16 15:15:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3129 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 15:15:12.483652 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c00f1fcb-3deb-450f-afc6-59e9444eadb8 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Action: 'create', calling method: .version_select at 0x7f0c896511f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1389908958", "metadata": {"Type": "work"}}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c00f1fcb-3deb-450f-afc6-59e9444eadb8 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Request method failure captured: May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 120 May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmp9T7EGPNIdNKH_X0raPRRwOpZpJU9ahM1v-so4EuOg2DrIHNA_WJu_lJZOKAbm8aBBe0r3TrJNiTguzbtLjZQr8Md6VdccOptQP0fjYy0spVfJYNpQEmp-cwMMNV6SPcce4CW1M_YVkw-ocyEo8L8KrxtkH2T1m06IqHnQr9DKg4k May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:15:12.496907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d45888465c0f408a903d88d15bff69f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}] May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 8d4bbcec028b48e0ace0d2fe12ff5b49 May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1389908958", "metadata": {"Type": "work"}}} May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: May 16 15:15:12.498446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1389908958', 'metadata': {'Type': 'work'}}}} May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise error May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi '0' May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:12.499371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:15:12.501010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:15:12.502529 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:15:12.502529 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.502529 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c00f1fcb-3deb-450f-afc6-59e9444eadb8 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:12.505113 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c00f1fcb-3deb-450f-afc6-59e9444eadb8 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022140 May 16 15:15:12.506452 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 2/3] 10.222.0.71 () {60 vars in 1155 bytes} [Mon May 16 15:15:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:15:12.550729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-33aa9fff-b3f8-4ce6-84ba-0ac29aa38471 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Calling method '.version_select at 0x7f0c89651310>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:12.648036 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-33aa9fff-b3f8-4ce6-84ba-0ac29aa38471 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814" status: 200 len: 353 microversion: 2.1 time: 0.140483 May 16 15:15:12.655391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 3/4] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:12 2022] GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:12.663398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-37f2f570-a990-4f20-bb6c-6e80024f8a9e tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Action: 'create', calling method: .version_select at 0x7f0c89651040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1122360947", "metadata": {"Type": "work"}}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-37f2f570-a990-4f20-bb6c-6e80024f8a9e tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Request method failure captured: May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 119 May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmp9T7EGPNIdNKH_X0raPRRwOpZpJU9ahM1v-so4EuOg2DrIHNA_WJu_lJZOKAbm8aBBe0r3TrJNiTguzbtLjZQr8Md6VdccOptQP0fjYy0spVfJYNpQEmp-cwMMNV6SPcce4CW1M_YVkw-ocyEo8L8KrxtkH2T1m06IqHnQr9DKg4k May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:15:12.669149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d45888465c0f408a903d88d15bff69f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}] May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 8d4bbcec028b48e0ace0d2fe12ff5b49 May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1122360947", "metadata": {"Type": "work"}}} May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: May 16 15:15:12.670490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1122360947', 'metadata': {'Type': 'work'}}}} May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise error May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi '' May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:12.671262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:15:12.673365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:15:12.675913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:15:12.675913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.675913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-37f2f570-a990-4f20-bb6c-6e80024f8a9e tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:12.675913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-37f2f570-a990-4f20-bb6c-6e80024f8a9e tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014098 May 16 15:15:12.676713 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 4/5] 10.222.0.71 () {60 vars in 1155 bytes} [Mon May 16 15:15:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:15:12.683045 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0941d94f-d52c-4f69-8178-e517184ae193 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Calling method '.version_select at 0x7f0c8964eb80>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:12.715561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-0941d94f-d52c-4f69-8178-e517184ae193 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] HTTP exception thrown: Volume tempest-invalid-152734892 could not be found. May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0941d94f-d52c-4f69-8178-e517184ae193 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Request method failure captured: May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-152734892 HTTP/1.1 May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmp9T7EGPNIdNKH_X0raPRRwOpZpJU9ahM1v-so4EuOg2DrIHNA_WJu_lJZOKAbm8aBBe0r3TrJNiTguzbtLjZQr8Md6VdccOptQP0fjYy0spVfJYNpQEmp-cwMMNV6SPcce4CW1M_YVkw-ocyEo8L8KrxtkH2T1m06IqHnQr9DKg4k May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:15:12.720450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d45888465c0f408a903d88d15bff69f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}] May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 8d4bbcec028b48e0ace0d2fe12ff5b49 May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Volume tempest-invalid-152734892 could not be found. May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'tempest-invalid-152734892'} May 16 15:15:12.722185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-152734892 could not be found. (HTTP 404) (Request-ID: req-59b08f4d-b4c1-44c5-9d5a-7e1566a31e23) May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.723737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:15:12.725119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-152734892 could not be found. May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:15:12.726310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-152734892 could not be found. May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-152734892 could not be found. May 16 15:15:12.727544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.730842 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0941d94f-d52c-4f69-8178-e517184ae193 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Returning 404 to user: Volume tempest-invalid-152734892 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:12.731757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0941d94f-d52c-4f69-8178-e517184ae193 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/tempest-invalid-152734892" status: 404 len: 98 microversion: 2.1 time: 0.053562 May 16 15:15:12.732317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 5/6] 10.222.0.71 () {58 vars in 1214 bytes} [Mon May 16 15:15:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-152734892 => generated 98 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 16 15:15:12.746401 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-64b6c76e-3e75-4cc0-8b99-8aca6bbab0fc tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007895 May 16 15:15:12.750921 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 6/7] 10.222.0.71 () {58 vars in 1139 bytes} [Mon May 16 15:15:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 15:15:12.772647 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5434da23-f290-419a-916b-ef9e413c81e0 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013781 May 16 15:15:12.773263 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 7/8] 10.222.0.71 () {58 vars in 1136 bytes} [Mon May 16 15:15:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 15:15:12.793699 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cd302ed6-af8a-4ba0-8d50-5407bfe12b68 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Calling method '.version_select at 0x7f0c895d9310>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:12.834669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-cd302ed6-af8a-4ba0-8d50-5407bfe12b68 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] HTTP exception thrown: Volume cb36c04f-a2df-4179-8411-43b26541f720 could not be found. May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cd302ed6-af8a-4ba0-8d50-5407bfe12b68 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Request method failure captured: May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/os-volumes/cb36c04f-a2df-4179-8411-43b26541f720 HTTP/1.1 May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmp9T7EGPNIdNKH_X0raPRRwOpZpJU9ahM1v-so4EuOg2DrIHNA_WJu_lJZOKAbm8aBBe0r3TrJNiTguzbtLjZQr8Md6VdccOptQP0fjYy0spVfJYNpQEmp-cwMMNV6SPcce4CW1M_YVkw-ocyEo8L8KrxtkH2T1m06IqHnQr9DKg4k May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:15:12.836773 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d45888465c0f408a903d88d15bff69f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}] May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 8d4bbcec028b48e0ace0d2fe12ff5b49 May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Volume cb36c04f-a2df-4179-8411-43b26541f720 could not be found. May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'cb36c04f-a2df-4179-8411-43b26541f720'} May 16 15:15:12.838346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb36c04f-a2df-4179-8411-43b26541f720 could not be found. (HTTP 404) (Request-ID: req-314ce0b5-ba01-433c-9837-2dbca29e2930) May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.839300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:15:12.840757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb36c04f-a2df-4179-8411-43b26541f720 could not be found. May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:15:12.842079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb36c04f-a2df-4179-8411-43b26541f720 could not be found. May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb36c04f-a2df-4179-8411-43b26541f720 could not be found. May 16 15:15:12.843398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.845649 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cd302ed6-af8a-4ba0-8d50-5407bfe12b68 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Returning 404 to user: Volume cb36c04f-a2df-4179-8411-43b26541f720 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:12.846667 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cd302ed6-af8a-4ba0-8d50-5407bfe12b68 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/cb36c04f-a2df-4179-8411-43b26541f720" status: 404 len: 109 microversion: 2.1 time: 0.067860 May 16 15:15:12.848452 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 8/9] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:15:12 2022] DELETE /compute/v2.1/os-volumes/cb36c04f-a2df-4179-8411-43b26541f720 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:15:12.858451 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-71244339-f219-453c-a444-dec58bf8c491 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Calling method '.version_select at 0x7f0c8964e040>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:12.912858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-71244339-f219-453c-a444-dec58bf8c491 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] HTTP exception thrown: Volume 8ac96743-0823-46fc-94ff-9bc803392850 could not be found. May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-71244339-f219-453c-a444-dec58bf8c491 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Request method failure captured: May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/os-volumes/8ac96743-0823-46fc-94ff-9bc803392850 HTTP/1.1 May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmp9T7EGPNIdNKH_X0raPRRwOpZpJU9ahM1v-so4EuOg2DrIHNA_WJu_lJZOKAbm8aBBe0r3TrJNiTguzbtLjZQr8Md6VdccOptQP0fjYy0spVfJYNpQEmp-cwMMNV6SPcce4CW1M_YVkw-ocyEo8L8KrxtkH2T1m06IqHnQr9DKg4k May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:15:12.920089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d45888465c0f408a903d88d15bff69f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d45888465c0f408a903d88d15bff69f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d45888465c0f408a903d88d15bff69f2"}]}] May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: d45888465c0f408a903d88d15bff69f2 May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesNegativeTest-1843091239 May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 8d4bbcec028b48e0ace0d2fe12ff5b49 May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesNegativeTest-1843091239-project May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Volume 8ac96743-0823-46fc-94ff-9bc803392850 could not be found. May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '8ac96743-0823-46fc-94ff-9bc803392850'} May 16 15:15:12.921746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ac96743-0823-46fc-94ff-9bc803392850 could not be found. (HTTP 404) (Request-ID: req-5de24906-a975-4414-8311-d1082b2857a6) May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.922761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:12.924292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ac96743-0823-46fc-94ff-9bc803392850 could not be found. May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:15:12.925904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ac96743-0823-46fc-94ff-9bc803392850 could not be found. May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ac96743-0823-46fc-94ff-9bc803392850 could not be found. May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-71244339-f219-453c-a444-dec58bf8c491 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] Returning 404 to user: Volume 8ac96743-0823-46fc-94ff-9bc803392850 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:12.927364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-71244339-f219-453c-a444-dec58bf8c491 tempest-VolumesNegativeTest-1843091239 tempest-VolumesNegativeTest-1843091239-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/8ac96743-0823-46fc-94ff-9bc803392850" status: 404 len: 109 microversion: 2.1 time: 0.069666 May 16 15:15:12.936042 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 9/10] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:12 2022] GET /compute/v2.1/os-volumes/8ac96743-0823-46fc-94ff-9bc803392850 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:15:13.092885 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-af76561e-782e-4523-8eb3-87f62ead2eaf tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.334846 May 16 15:15:13.093874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 2/11] 10.222.0.71 () {60 vars in 1154 bytes} [Mon May 16 15:15:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2337 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 15:15:13.108353 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0154ab5f-f294-45aa-b2b7-04fb2984abde tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c8964e3a0>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:13.216847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0154ab5f-f294-45aa-b2b7-04fb2984abde tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7" status: 200 len: 345 microversion: 2.1 time: 0.114835 May 16 15:15:13.217834 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 10/12] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:13 2022] GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:13.662346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-16476aef-9fa9-4ed5-9bb2-ee23fe51ed65 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Calling method '.version_select at 0x7f0c895d91f0>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:13.754875 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-16476aef-9fa9-4ed5-9bb2-ee23fe51ed65 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814" status: 200 len: 354 microversion: 2.1 time: 0.090353 May 16 15:15:13.754875 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 11/13] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:13 2022] GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:13.760820 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-87d5b087-453a-4eeb-a25e-dd50cde209b7 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Calling method '.version_select at 0x7f0c895d9430>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:13.865930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-87d5b087-453a-4eeb-a25e-dd50cde209b7 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814" status: 200 len: 354 microversion: 2.1 time: 0.109226 May 16 15:15:13.885665 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 12/14] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:13 2022] GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814 => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:13.890905 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-080972bd-595b-4da8-800d-ca2cf96e1117 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Calling method '.version_select at 0x7f0c895de040>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:14.211154 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1840872963", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "networks": [{"uuid": "f37b9220-2ab1-4d4b-a8dd-74c9a4a9270e"}]}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:14.287590 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] validate_networks() for [('f37b9220-2ab1-4d4b-a8dd-74c9a4a9270e', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:14.414950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-080972bd-595b-4da8-800d-ca2cf96e1117 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814" status: 202 len: 0 microversion: 2.1 time: 0.507833 May 16 15:15:14.414950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 13/15] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:15:13 2022] DELETE /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:15:14.414950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e8eee4e0-b5f9-4261-b4b5-aa0318608844 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c895d90d0>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:14.505408 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e8eee4e0-b5f9-4261-b4b5-aa0318608844 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7" status: 200 len: 346 microversion: 2.1 time: 0.105095 May 16 15:15:14.505982 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 14/16] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:14 2022] GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:14.511837 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-31404c1a-ebb4-4392-9b20-db1130c7c440 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Calling method '.version_select at 0x7f0c8994be50>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:14.642280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-31404c1a-ebb4-4392-9b20-db1130c7c440 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814" status: 200 len: 353 microversion: 2.1 time: 0.134933 May 16 15:15:14.643348 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 15/17] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:14 2022] GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:14.664459 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f2ebb256-46f1-41db-8d20-618601c9e992 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Action: 'create', calling method: .version_select at 0x7f0c8964ef70>, body: {"snapshot": {"volume_id": "97b1c9b4-caf1-4c29-a745-0e8a3033c7e7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1048630823"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:15.419186 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f2ebb256-46f1-41db-8d20-618601c9e992 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.774413 May 16 15:15:15.419792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 16/18] 10.222.0.71 () {60 vars in 1161 bytes} [Mon May 16 15:15:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:15.430368 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7779ba08-41ba-449e-b105-7596f007385c tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c895de3a0>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:15.550039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7779ba08-41ba-449e-b105-7596f007385c tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0" status: 200 len: 287 microversion: 2.1 time: 0.124007 May 16 15:15:15.550679 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 17/19] 10.222.0.71 () {58 vars in 1250 bytes} [Mon May 16 15:15:15 2022] GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:15.561435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5fb03d87-1b7d-4287-a1a5-362c00531bf9 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c8964e790>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:15.652918 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5fb03d87-1b7d-4287-a1a5-362c00531bf9 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.095139 May 16 15:15:15.653548 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 18/20] 10.222.0.71 () {58 vars in 1139 bytes} [Mon May 16 15:15:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:15.658204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ab670665-7c64-4d3d-a61d-79d5b05abef6 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Calling method '.version_select at 0x7f0c895d9ca0>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:15.707764 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-ab670665-7c64-4d3d-a61d-79d5b05abef6 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] HTTP exception thrown: Volume f7242101-f80b-447a-bc3c-5f49621d0814 could not be found. May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ab670665-7c64-4d3d-a61d-79d5b05abef6 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Request method failure captured: May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814 HTTP/1.1 May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmp9jztzcC-DBBYr_4TndnrLWkMCozlE09Y7mLiNcBAQGwn1SjoBH3IdCy7Klbhb0tH6JcHVqOCS8GyX7f5fncQv9QnmNR7WKYSsyH6UBDZsq06VszA07oLW0v2FypF3qQzB6VET-7Hy93vccRKzr_Us-C9rzFWYGoCiY7WC1BxXZlY May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 458b23cc639f45899815590248afe298 May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesGetTestJSON-1169685639 May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:15:15.711564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/458b23cc639f45899815590248afe298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/458b23cc639f45899815590248afe298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_458b23cc639f45899815590248afe298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/458b23cc639f45899815590248afe298"}]}] May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesGetTestJSON-1169685639 May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 458b23cc639f45899815590248afe298 May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesGetTestJSON-1169685639 May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesGetTestJSON-1169685639-project May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 7e4564c8f0b7416493f411749b4f9d9f May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesGetTestJSON-1169685639-project May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Volume f7242101-f80b-447a-bc3c-5f49621d0814 could not be found. May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'f7242101-f80b-447a-bc3c-5f49621d0814'} May 16 15:15:15.713286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7242101-f80b-447a-bc3c-5f49621d0814 could not be found. (HTTP 404) (Request-ID: req-09b76457-9d5a-4b0a-b77c-a2af860f4854) May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:15.714061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:15.715145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7242101-f80b-447a-bc3c-5f49621d0814 could not be found. May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:15:15.716321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7242101-f80b-447a-bc3c-5f49621d0814 could not be found. May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7242101-f80b-447a-bc3c-5f49621d0814 could not be found. May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:15.717392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ab670665-7c64-4d3d-a61d-79d5b05abef6 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] Returning 404 to user: Volume f7242101-f80b-447a-bc3c-5f49621d0814 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:15.718834 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ab670665-7c64-4d3d-a61d-79d5b05abef6 tempest-VolumesGetTestJSON-1169685639 tempest-VolumesGetTestJSON-1169685639-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814" status: 404 len: 109 microversion: 2.1 time: 0.064259 May 16 15:15:15.720027 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 19/21] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:15 2022] GET /compute/v2.1/os-volumes/f7242101-f80b-447a-bc3c-5f49621d0814 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:15:15.727230 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ee43511e-cd99-47f4-bc00-b249c406cfe0 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c8964e0d0>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:15.729008 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:15.729534 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:15.730110 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:15.730639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:15.731146 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:15.790324 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:15.795793 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:15.795793 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:15.796454 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ee43511e-cd99-47f4-bc00-b249c406cfe0 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0" status: 200 len: 287 microversion: 2.1 time: 0.075241 May 16 15:15:15.797631 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 20/22] 10.222.0.71 () {58 vars in 1250 bytes} [Mon May 16 15:15:15 2022] GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:15.798553 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:15.891009 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Getting quotas for project 494afadf76c94f859b141309a6a3e37b. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:15.903111 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Getting quotas for user f3dc7683c04d42ffa5642c97a2f25d1d and project 494afadf76c94f859b141309a6a3e37b. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:15.920227 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:15.924339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:16.286686 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ddcb231c-efff-449e-b975-b531aa9c8f69 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.863049 May 16 15:15:16.287026 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 3/23] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:15:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:15:16.295753 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3535cd8e-01d4-4b6c-a452-da26f4a7816d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:16.296589 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3535cd8e-01d4-4b6c-a452-da26f4a7816d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:16.587752 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3535cd8e-01d4-4b6c-a452-da26f4a7816d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:16.634102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3535cd8e-01d4-4b6c-a452-da26f4a7816d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1215 microversion: 2.1 time: 0.345801 May 16 15:15:16.636311 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 21/24] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:16 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1215 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:16.810150 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-83778ad5-d48b-4b78-a62d-4906649e7291 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c88d183a0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:16.869032 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-83778ad5-d48b-4b78-a62d-4906649e7291 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0" status: 200 len: 287 microversion: 2.1 time: 0.064228 May 16 15:15:16.871972 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 4/25] 10.222.0.71 () {58 vars in 1250 bytes} [Mon May 16 15:15:16 2022] GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:17.651352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cf084ef2-c4ee-4def-a26f-2b8ee28ebad5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:17.651998 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cf084ef2-c4ee-4def-a26f-2b8ee28ebad5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:17.815026 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-cf084ef2-c4ee-4def-a26f-2b8ee28ebad5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:17.828852 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cf084ef2-c4ee-4def-a26f-2b8ee28ebad5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1215 microversion: 2.1 time: 0.180401 May 16 15:15:17.828852 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 22/26] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:17 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:17.883849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7d20b9f5-852b-4983-b89f-1a8f15223aec tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c88d18af0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:17.945244 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7d20b9f5-852b-4983-b89f-1a8f15223aec tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0" status: 200 len: 287 microversion: 2.1 time: 0.066613 May 16 15:15:17.945919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 5/27] 10.222.0.71 () {58 vars in 1250 bytes} [Mon May 16 15:15:17 2022] GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:18.845545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a45eb888-7671-4203-a560-1a59fb62d500 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:18.846670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a45eb888-7671-4203-a560-1a59fb62d500 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:19.022718 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1216924056", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:19.044493 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a45eb888-7671-4203-a560-1a59fb62d500 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:19.076990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a45eb888-7671-4203-a560-1a59fb62d500 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1215 microversion: 2.1 time: 0.235885 May 16 15:15:19.077764 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 6/28] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:18 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:19.091529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-bacba780-a92d-4913-82a4-bd3d7179e2f7 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c88d275e0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:19.156931 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-bacba780-a92d-4913-82a4-bd3d7179e2f7 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0" status: 200 len: 288 microversion: 2.1 time: 0.075137 May 16 15:15:19.156931 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 7/29] 10.222.0.71 () {58 vars in 1250 bytes} [Mon May 16 15:15:19 2022] GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:19.167856 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d9890c6f-03ee-475c-8f14-0462698a0fbd tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c884c5a60>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:19.299282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] validate_networks() for [('be046d4b-8cff-4819-b7cd-e793c832b714', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:19.405868 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d9890c6f-03ee-475c-8f14-0462698a0fbd tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "DELETE /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0" status: 202 len: 0 microversion: 2.1 time: 0.241756 May 16 15:15:19.409688 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 8/30] 10.222.0.71 () {58 vars in 1253 bytes} [Mon May 16 15:15:19 2022] DELETE /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:15:19.419175 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ebae81b3-c794-47c6-b370-702c536ce3b2 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c884d1160>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:19.515498 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ebae81b3-c794-47c6-b370-702c536ce3b2 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0" status: 200 len: 287 microversion: 2.1 time: 0.103427 May 16 15:15:19.516252 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 9/31] 10.222.0.71 () {58 vars in 1250 bytes} [Mon May 16 15:15:19 2022] GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:20.093780 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-91fe01d9-ea8b-4aa3-bcb6-ece17fe37b91 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:20.094396 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-91fe01d9-ea8b-4aa3-bcb6-ece17fe37b91 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:20.107411 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-91fe01d9-ea8b-4aa3-bcb6-ece17fe37b91 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:20.111038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-91fe01d9-ea8b-4aa3-bcb6-ece17fe37b91 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:20.115724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-91fe01d9-ea8b-4aa3-bcb6-ece17fe37b91 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:20.116472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-91fe01d9-ea8b-4aa3-bcb6-ece17fe37b91 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:20.580803 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-91fe01d9-ea8b-4aa3-bcb6-ece17fe37b91 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:20.617976 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-91fe01d9-ea8b-4aa3-bcb6-ece17fe37b91 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1219 microversion: 2.1 time: 0.523084 May 16 15:15:20.627942 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 10/32] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:20 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1219 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:20.627942 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-533e61f1-ef00-4144-ae46-ea336faa20fc tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c88456280>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:20.677568 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-533e61f1-ef00-4144-ae46-ea336faa20fc tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] HTTP exception thrown: Snapshot 7b1a860d-119c-40a1-8b8d-4092a37240e0 could not be found. May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-533e61f1-ef00-4144-ae46-ea336faa20fc tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Request method failure captured: May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 HTTP/1.1 May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmp9874DDALDXme3A_H7MufaEia7X4Oi9e1pacRqrEg5PIEXm_Vu-MCV9T2Oo98SIo24MwEmbElow3oRAE_cL_t13rKulcsJL84b1TiaFfGW63V-UIxfhHolNt7GcopuRNeZHK1WC2oyZD0DBBo1xUWpONMOtPzxqIzFsNXGXuE5FXI May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: dc83025212a2416ba02124f26c956a04 May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:15:20.681366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/dc83025212a2416ba02124f26c956a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/dc83025212a2416ba02124f26c956a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_dc83025212a2416ba02124f26c956a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/dc83025212a2416ba02124f26c956a04"}]}] May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: dc83025212a2416ba02124f26c956a04 May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-VolumesSnapshotsTestJSON-630768419-project May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 7ba85ecaa6d04e5aa2d6443ab0b19ba1 May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-VolumesSnapshotsTestJSON-630768419-project May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Snapshot 7b1a860d-119c-40a1-8b8d-4092a37240e0 could not be found. May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '7b1a860d-119c-40a1-8b8d-4092a37240e0'} May 16 15:15:20.683270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7b1a860d-119c-40a1-8b8d-4092a37240e0 could not be found. (HTTP 404) (Request-ID: req-15ed1a11-f363-4ce0-860e-26746da0d6bc) May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:20.683911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:20.685519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7b1a860d-119c-40a1-8b8d-4092a37240e0 could not be found. May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 15:15:20.688106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7b1a860d-119c-40a1-8b8d-4092a37240e0 could not be found. May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7b1a860d-119c-40a1-8b8d-4092a37240e0 could not be found. May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-533e61f1-ef00-4144-ae46-ea336faa20fc tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Returning 404 to user: Snapshot 7b1a860d-119c-40a1-8b8d-4092a37240e0 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-533e61f1-ef00-4144-ae46-ea336faa20fc tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0" status: 404 len: 111 microversion: 2.1 time: 0.063232 May 16 15:15:20.689290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 11/33] 10.222.0.71 () {58 vars in 1250 bytes} [Mon May 16 15:15:20 2022] GET /compute/v2.1/os-snapshots/7b1a860d-119c-40a1-8b8d-4092a37240e0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:15:20.700001 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-fc23a6a4-a55a-401f-ad30-510920e30121 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c88475f70>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:20.969542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-fc23a6a4-a55a-401f-ad30-510920e30121 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7" status: 202 len: 0 microversion: 2.1 time: 0.278233 May 16 15:15:20.973555 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 12/34] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:15:20 2022] DELETE /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:15:20.979318 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1975b95e-be57-4b66-96a1-5ff946665bc7 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c883c8700>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:21.056887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:21.057890 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:21.058605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:21.059577 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:21.061360 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:21.062401 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1975b95e-be57-4b66-96a1-5ff946665bc7 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7" status: 200 len: 345 microversion: 2.1 time: 0.087469 May 16 15:15:21.063372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 13/35] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:20 2022] GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:21.108896 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:21.111441 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:21.115989 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:21.116611 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:21.190283 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Getting quotas for project e1e340fabe31456cb021fcd0b5f505b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:21.206048 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Getting quotas for user 97021ddaffff4e088961ba1873a8e697 and project e1e340fabe31456cb021fcd0b5f505b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:21.234174 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:21.245654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:21.547911 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ec4ffb39-76d2-4dbd-a41c-e89293989866 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.069504 May 16 15:15:21.548860 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 23/36] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:15:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:15:21.560524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-81622fcc-470c-4f95-bf3d-0bf237df21f2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:21.562281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-81622fcc-470c-4f95-bf3d-0bf237df21f2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:21.637181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-550e9eb2-c15a-4ddd-95ce-2a590115ee49 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:21.638677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-550e9eb2-c15a-4ddd-95ce-2a590115ee49 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:21.648164 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-550e9eb2-c15a-4ddd-95ce-2a590115ee49 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:21.648914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-550e9eb2-c15a-4ddd-95ce-2a590115ee49 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:21.649915 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-550e9eb2-c15a-4ddd-95ce-2a590115ee49 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:21.650922 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-550e9eb2-c15a-4ddd-95ce-2a590115ee49 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:21.785871 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-81622fcc-470c-4f95-bf3d-0bf237df21f2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:21.809756 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-81622fcc-470c-4f95-bf3d-0bf237df21f2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1222 microversion: 2.1 time: 0.254170 May 16 15:15:21.839703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 14/37] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:21 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1222 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:22.006380 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-550e9eb2-c15a-4ddd-95ce-2a590115ee49 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:22.048647 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-550e9eb2-c15a-4ddd-95ce-2a590115ee49 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1275 microversion: 2.1 time: 0.417869 May 16 15:15:22.049439 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 24/38] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:21 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1275 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:22.077161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5a22ba3f-de98-4b82-9d32-2e9a8ac83beb tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c883c8d30>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:22.147343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-5a22ba3f-de98-4b82-9d32-2e9a8ac83beb tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] HTTP exception thrown: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5a22ba3f-de98-4b82-9d32-2e9a8ac83beb tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Request method failure captured: May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 HTTP/1.1 May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmp9874DDALDXme3A_H7MufaEia7X4Oi9e1pacRqrEg5PIEXm_Vu-MCV9T2Oo98SIo24MwEmbElow3oRAE_cL_t13rKulcsJL84b1TiaFfGW63V-UIxfhHolNt7GcopuRNeZHK1WC2oyZD0DBBo1xUWpONMOtPzxqIzFsNXGXuE5FXI May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: dc83025212a2416ba02124f26c956a04 May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:15:22.149660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/dc83025212a2416ba02124f26c956a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/dc83025212a2416ba02124f26c956a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_dc83025212a2416ba02124f26c956a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/dc83025212a2416ba02124f26c956a04"}]}] May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: dc83025212a2416ba02124f26c956a04 May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-VolumesSnapshotsTestJSON-630768419-project May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 7ba85ecaa6d04e5aa2d6443ab0b19ba1 May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-VolumesSnapshotsTestJSON-630768419-project May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '97b1c9b4-caf1-4c29-a745-0e8a3033c7e7'} May 16 15:15:22.150726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. (HTTP 404) (Request-ID: req-252d6129-f3ae-4310-80ee-5038044e54cf) May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.151448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:22.152432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:15:22.153373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5a22ba3f-de98-4b82-9d32-2e9a8ac83beb tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Returning 404 to user: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5a22ba3f-de98-4b82-9d32-2e9a8ac83beb tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7" status: 404 len: 109 microversion: 2.1 time: 0.079232 May 16 15:15:22.154226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 15/39] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:22 2022] GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:15:22.166258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d8aa091d-1f16-4a30-bb29-a57af1f8bdc6 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c88480d30>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:22.230888 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1027664523", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:22.258232 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-d8aa091d-1f16-4a30-bb29-a57af1f8bdc6 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] HTTP exception thrown: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d8aa091d-1f16-4a30-bb29-a57af1f8bdc6 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Request method failure captured: May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 HTTP/1.1 May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmp9874DDALDXme3A_H7MufaEia7X4Oi9e1pacRqrEg5PIEXm_Vu-MCV9T2Oo98SIo24MwEmbElow3oRAE_cL_t13rKulcsJL84b1TiaFfGW63V-UIxfhHolNt7GcopuRNeZHK1WC2oyZD0DBBo1xUWpONMOtPzxqIzFsNXGXuE5FXI May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: dc83025212a2416ba02124f26c956a04 May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:15:22.260522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/dc83025212a2416ba02124f26c956a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/dc83025212a2416ba02124f26c956a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_dc83025212a2416ba02124f26c956a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/dc83025212a2416ba02124f26c956a04"}]}] May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: dc83025212a2416ba02124f26c956a04 May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesSnapshotsTestJSON-630768419-project May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 7ba85ecaa6d04e5aa2d6443ab0b19ba1 May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesSnapshotsTestJSON-630768419-project May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '97b1c9b4-caf1-4c29-a745-0e8a3033c7e7'} May 16 15:15:22.261568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. (HTTP 404) (Request-ID: req-443ac032-e7e6-40ed-90d9-b993020fd965) May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.262201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:15:22.263080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:15:22.264646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d8aa091d-1f16-4a30-bb29-a57af1f8bdc6 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Returning 404 to user: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d8aa091d-1f16-4a30-bb29-a57af1f8bdc6 tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7" status: 404 len: 109 microversion: 2.1 time: 0.099906 May 16 15:15:22.265499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 25/40] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:15:22 2022] DELETE /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:15:22.273526 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2c904a00-ccaa-4812-9252-0c29a8d950be tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Calling method '.version_select at 0x7f0c8840eb80>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:22.358838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-2c904a00-ccaa-4812-9252-0c29a8d950be tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] HTTP exception thrown: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2c904a00-ccaa-4812-9252-0c29a8d950be tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Request method failure captured: May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 HTTP/1.1 May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmp9874DDALDXme3A_H7MufaEia7X4Oi9e1pacRqrEg5PIEXm_Vu-MCV9T2Oo98SIo24MwEmbElow3oRAE_cL_t13rKulcsJL84b1TiaFfGW63V-UIxfhHolNt7GcopuRNeZHK1WC2oyZD0DBBo1xUWpONMOtPzxqIzFsNXGXuE5FXI May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: dc83025212a2416ba02124f26c956a04 May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:15:22.360974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/dc83025212a2416ba02124f26c956a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/dc83025212a2416ba02124f26c956a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_dc83025212a2416ba02124f26c956a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/dc83025212a2416ba02124f26c956a04"}]}] May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: dc83025212a2416ba02124f26c956a04 May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-630768419 May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesSnapshotsTestJSON-630768419-project May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 7ba85ecaa6d04e5aa2d6443ab0b19ba1 May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesSnapshotsTestJSON-630768419-project May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '97b1c9b4-caf1-4c29-a745-0e8a3033c7e7'} May 16 15:15:22.365709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. (HTTP 404) (Request-ID: req-51358e27-e679-420c-b3e2-e2fa72976f3f) May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.366495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:15:22.367704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:15:22.368792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2c904a00-ccaa-4812-9252-0c29a8d950be tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] Returning 404 to user: Volume 97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2c904a00-ccaa-4812-9252-0c29a8d950be tempest-VolumesSnapshotsTestJSON-630768419 tempest-VolumesSnapshotsTestJSON-630768419-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7" status: 404 len: 109 microversion: 2.1 time: 0.095798 May 16 15:15:22.369893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 26/41] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:15:22 2022] GET /compute/v2.1/os-volumes/97b1c9b4-caf1-4c29-a745-0e8a3033c7e7 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:15:22.398988 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] validate_networks() for [('be046d4b-8cff-4819-b7cd-e793c832b714', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:23.068189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1bf6eb0c-2363-48a3-94bb-1e813fa944bc tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:23.069570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1bf6eb0c-2363-48a3-94bb-1e813fa944bc tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:23.088078 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1bf6eb0c-2363-48a3-94bb-1e813fa944bc tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:23.090476 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1bf6eb0c-2363-48a3-94bb-1e813fa944bc tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:23.092327 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1bf6eb0c-2363-48a3-94bb-1e813fa944bc tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:23.095262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1bf6eb0c-2363-48a3-94bb-1e813fa944bc tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:23.497384 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1bf6eb0c-2363-48a3-94bb-1e813fa944bc tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:23.508501 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1bf6eb0c-2363-48a3-94bb-1e813fa944bc tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1273 microversion: 2.1 time: 0.446205 May 16 15:15:23.515583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 27/42] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:23 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:23.751472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:23.754374 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:23.755166 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:23.756738 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:23.757939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:23.793534 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:23.794287 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:23.797088 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:23.797806 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:23.854280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Getting quotas for project e1e340fabe31456cb021fcd0b5f505b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:23.874614 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Getting quotas for user 97021ddaffff4e088961ba1873a8e697 and project e1e340fabe31456cb021fcd0b5f505b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:23.911268 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:23.913630 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:24.146381 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b8317d6b-2112-4b2a-a5b2-1e93d75f9de1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.924087 May 16 15:15:24.152742 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 16/43] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:15:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 15:15:24.163300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4edbb745-5a6b-481d-9828-994953232b4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:24.163994 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4edbb745-5a6b-481d-9828-994953232b4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:24.421435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4edbb745-5a6b-481d-9828-994953232b4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:24.432587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4edbb745-5a6b-481d-9828-994953232b4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1222 microversion: 2.1 time: 0.273261 May 16 15:15:24.433884 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 28/44] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:24 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:24.536505 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7ae71cf2-4994-400e-a890-7e8cae088427 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:24.536505 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7ae71cf2-4994-400e-a890-7e8cae088427 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:24.541460 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7ae71cf2-4994-400e-a890-7e8cae088427 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:24.542100 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7ae71cf2-4994-400e-a890-7e8cae088427 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:24.543096 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7ae71cf2-4994-400e-a890-7e8cae088427 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:24.543729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7ae71cf2-4994-400e-a890-7e8cae088427 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:25.325996 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7ae71cf2-4994-400e-a890-7e8cae088427 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:25.334031 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7ae71cf2-4994-400e-a890-7e8cae088427 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.808800 May 16 15:15:25.343745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 17/45] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:24 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:25.452125 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d75c021c-4879-42bf-95c7-b8ae437ef1c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:25.453562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d75c021c-4879-42bf-95c7-b8ae437ef1c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:25.591338 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d75c021c-4879-42bf-95c7-b8ae437ef1c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:25.604491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d75c021c-4879-42bf-95c7-b8ae437ef1c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1222 microversion: 2.1 time: 0.156548 May 16 15:15:25.605396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 29/46] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:25 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:26.297932 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ad560e8c-8413-4943-a6e0-09f554bb536c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: .version_select at 0x7f0c883fcf70>, body: {"keypair": {"name": "tempest-keypair-1799433840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSa2+ogpRCSBVL3xNrGIWu1w1gNJ9fURqg0hRqsvICoUGJgmSek3v03YjJtIT73VeCcbjL/biR9HpKGEYTdBxMptWobBZ9RXpfEY1ht2mHAVY1H4C+xYrSmua9rwX0MOw=="}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:26.352153 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7c596f9c-2354-47e5-8ee5-2ecffcac520b tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:26.352783 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7c596f9c-2354-47e5-8ee5-2ecffcac520b tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:26.359881 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7c596f9c-2354-47e5-8ee5-2ecffcac520b tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:26.360380 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7c596f9c-2354-47e5-8ee5-2ecffcac520b tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:26.361249 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7c596f9c-2354-47e5-8ee5-2ecffcac520b tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:26.361696 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7c596f9c-2354-47e5-8ee5-2ecffcac520b tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:26.371027 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-ad560e8c-8413-4943-a6e0-09f554bb536c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:26.386915 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-ad560e8c-8413-4943-a6e0-09f554bb536c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for user d38cdf40e33b47d8aa79e029cded7503 and project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:26.621171 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ad560e8c-8413-4943-a6e0-09f554bb536c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.602367 May 16 15:15:26.627373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 18/47] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:15:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:26.633680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-895d5c6c-9b83-46c9-8263-69932d628a3d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:26.639617 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-895d5c6c-9b83-46c9-8263-69932d628a3d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:26.657039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-895d5c6c-9b83-46c9-8263-69932d628a3d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:26.657039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-895d5c6c-9b83-46c9-8263-69932d628a3d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:26.657039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-895d5c6c-9b83-46c9-8263-69932d628a3d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:26.663834 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-895d5c6c-9b83-46c9-8263-69932d628a3d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:27.365958 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7c596f9c-2354-47e5-8ee5-2ecffcac520b tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:27.390481 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7c596f9c-2354-47e5-8ee5-2ecffcac520b tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 1.042926 May 16 15:15:27.395467 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 30/48] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:26 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:27.503008 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-895d5c6c-9b83-46c9-8263-69932d628a3d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:27.515207 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-895d5c6c-9b83-46c9-8263-69932d628a3d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1226 microversion: 2.1 time: 0.886361 May 16 15:15:27.516856 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 19/49] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:26 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1226 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:28.410624 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c57b5ee5-277e-4650-8313-663af54fb420 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:28.411318 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c57b5ee5-277e-4650-8313-663af54fb420 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:28.432584 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c57b5ee5-277e-4650-8313-663af54fb420 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:28.433066 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c57b5ee5-277e-4650-8313-663af54fb420 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:28.438625 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c57b5ee5-277e-4650-8313-663af54fb420 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:28.439099 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c57b5ee5-277e-4650-8313-663af54fb420 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:28.535197 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d4ca1929-a7c9-4b52-82cb-3254b08082bf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:28.535871 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d4ca1929-a7c9-4b52-82cb-3254b08082bf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:28.557317 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4ca1929-a7c9-4b52-82cb-3254b08082bf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:28.565765 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4ca1929-a7c9-4b52-82cb-3254b08082bf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:28.573812 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4ca1929-a7c9-4b52-82cb-3254b08082bf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:28.580104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4ca1929-a7c9-4b52-82cb-3254b08082bf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:30.097794 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d4ca1929-a7c9-4b52-82cb-3254b08082bf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:30.125923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d4ca1929-a7c9-4b52-82cb-3254b08082bf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1282 microversion: 2.1 time: 1.594939 May 16 15:15:30.127161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 20/50] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:28 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1282 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:30.561374 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c57b5ee5-277e-4650-8313-663af54fb420 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:30.582381 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c57b5ee5-277e-4650-8313-663af54fb420 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 2.175001 May 16 15:15:30.589314 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 31/51] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:28 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:31.145381 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1ec859f7-d255-46a1-995e-34c895a7248a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:31.146005 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1ec859f7-d255-46a1-995e-34c895a7248a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:31.161832 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1ec859f7-d255-46a1-995e-34c895a7248a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:31.162945 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1ec859f7-d255-46a1-995e-34c895a7248a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:31.166540 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1ec859f7-d255-46a1-995e-34c895a7248a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:31.168710 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1ec859f7-d255-46a1-995e-34c895a7248a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:31.610993 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-98c9522a-3791-4dd5-84eb-86c5cc8f294e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:31.610993 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-98c9522a-3791-4dd5-84eb-86c5cc8f294e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:31.617852 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-98c9522a-3791-4dd5-84eb-86c5cc8f294e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:31.618315 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-98c9522a-3791-4dd5-84eb-86c5cc8f294e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:31.619147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-98c9522a-3791-4dd5-84eb-86c5cc8f294e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:31.619735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-98c9522a-3791-4dd5-84eb-86c5cc8f294e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:32.321849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1ec859f7-d255-46a1-995e-34c895a7248a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:32.348942 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1ec859f7-d255-46a1-995e-34c895a7248a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1280 microversion: 2.1 time: 1.206167 May 16 15:15:32.362867 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 21/52] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:31 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1280 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:32.656013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-98c9522a-3791-4dd5-84eb-86c5cc8f294e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:32.663942 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-98c9522a-3791-4dd5-84eb-86c5cc8f294e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 1.064948 May 16 15:15:32.666854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 32/53] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:31 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:32.705824 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ee99b94c-e006-46ad-b4cb-37a4a239e622 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'create', calling method: .version_select at 0x7f0c883850d0>, body: {"keypair": {"name": "tempest-keypair-758959174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmP8FIzcIEC59EJiDhNc8hsFhIdvAWLoPgqQCPyjxOVdGUaeu3hhC1st52beB3wDg/cdL14D8qzjskHyKL8wNO2wt4QdLAy2hp0lYZKl5WVLqzpMVgFtxO+4Ce64HjtZg=="}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:32.730998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-ee99b94c-e006-46ad-b4cb-37a4a239e622 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Getting quotas for project 64990eb359b54b0a8636a6e7619800a7. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:32.737550 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-ee99b94c-e006-46ad-b4cb-37a4a239e622 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Getting quotas for user 7b559cc982a846bea7f7f2077b7c455b and project 64990eb359b54b0a8636a6e7619800a7. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:32.845233 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ee99b94c-e006-46ad-b4cb-37a4a239e622 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.479277 May 16 15:15:32.846892 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 22/54] 10.222.0.71 () {62 vars in 1199 bytes} [Mon May 16 15:15:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 482 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 15:15:32.881486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-3e9f8d01-a71b-429d-a072-bf476b7d3626 req-e263269b-de89-4872-baa2-d68b4572d067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c247c0bb-0802-47bf-8790-6d17eb129c28", "tag": "01d8431d-7010-47b2-8c50-59586072403b"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:32.895988 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-3e9f8d01-a71b-429d-a072-bf476b7d3626 req-e263269b-de89-4872-baa2-d68b4572d067 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:32.897372 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-3e9f8d01-a71b-429d-a072-bf476b7d3626 req-e263269b-de89-4872-baa2-d68b4572d067 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:32.920387 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-3e9f8d01-a71b-429d-a072-bf476b7d3626 req-e263269b-de89-4872-baa2-d68b4572d067 service nova] Creating event network-changed:01d8431d-7010-47b2-8c50-59586072403b for instance c247c0bb-0802-47bf-8790-6d17eb129c28 on hv-cinder-84175 May 16 15:15:32.920916 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-3e9f8d01-a71b-429d-a072-bf476b7d3626 req-e263269b-de89-4872-baa2-d68b4572d067 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117676) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 15:15:32.922036 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83874295-2a16-4e58-b53b-e3a1784a66d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:32.922497 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83874295-2a16-4e58-b53b-e3a1784a66d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:32.923454 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83874295-2a16-4e58-b53b-e3a1784a66d5 None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:32.923912 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83874295-2a16-4e58-b53b-e3a1784a66d5 None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:32.933990 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.compute.rpcapi [None req-83874295-2a16-4e58-b53b-e3a1784a66d5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 15:15:32.935206 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83874295-2a16-4e58-b53b-e3a1784a66d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117676) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 15:15:32.976898 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-83874295-2a16-4e58-b53b-e3a1784a66d5 None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264446 May 16 15:15:32.977795 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 33/55] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:33.367448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5a5e5369-8a32-4b5b-a2b8-e73b923fa0ff tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:33.368180 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5a5e5369-8a32-4b5b-a2b8-e73b923fa0ff tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:33.377582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a5e5369-8a32-4b5b-a2b8-e73b923fa0ff tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:33.378039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a5e5369-8a32-4b5b-a2b8-e73b923fa0ff tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:33.379598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a5e5369-8a32-4b5b-a2b8-e73b923fa0ff tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:33.380087 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a5e5369-8a32-4b5b-a2b8-e73b923fa0ff tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:33.496844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5a5e5369-8a32-4b5b-a2b8-e73b923fa0ff tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:33.510150 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5a5e5369-8a32-4b5b-a2b8-e73b923fa0ff tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1280 microversion: 2.1 time: 0.147138 May 16 15:15:33.511343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 23/56] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:33 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:33.687278 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ee9d17b2-87dc-4ec1-b2f2-8c1bc29ef7ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:33.687278 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ee9d17b2-87dc-4ec1-b2f2-8c1bc29ef7ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:33.690769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ee9d17b2-87dc-4ec1-b2f2-8c1bc29ef7ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:33.691606 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ee9d17b2-87dc-4ec1-b2f2-8c1bc29ef7ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:33.692567 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ee9d17b2-87dc-4ec1-b2f2-8c1bc29ef7ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:33.693126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ee9d17b2-87dc-4ec1-b2f2-8c1bc29ef7ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:34.228402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ee9d17b2-87dc-4ec1-b2f2-8c1bc29ef7ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:34.237141 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ee9d17b2-87dc-4ec1-b2f2-8c1bc29ef7ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.558871 May 16 15:15:34.239085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 34/57] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:33 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:34.535919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0ca3af54-8982-42d0-9d09-be4017ee29ea tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:34.535919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0ca3af54-8982-42d0-9d09-be4017ee29ea tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:34.546572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0ca3af54-8982-42d0-9d09-be4017ee29ea tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:34.547158 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0ca3af54-8982-42d0-9d09-be4017ee29ea tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:34.549532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0ca3af54-8982-42d0-9d09-be4017ee29ea tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:34.552100 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0ca3af54-8982-42d0-9d09-be4017ee29ea tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.002284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0ca3af54-8982-42d0-9d09-be4017ee29ea tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:35.012400 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0ca3af54-8982-42d0-9d09-be4017ee29ea tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.484618 May 16 15:15:35.013003 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 24/58] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:34 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:35.254639 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e51e5fe4-bf5f-4f22-ac9c-f45baaaa56af tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:35.256581 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e51e5fe4-bf5f-4f22-ac9c-f45baaaa56af tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:35.277209 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e51e5fe4-bf5f-4f22-ac9c-f45baaaa56af tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.281739 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e51e5fe4-bf5f-4f22-ac9c-f45baaaa56af tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.281739 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e51e5fe4-bf5f-4f22-ac9c-f45baaaa56af tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.281739 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e51e5fe4-bf5f-4f22-ac9c-f45baaaa56af tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:36.030098 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6b93abfc-d7c6-4a1b-ae8c-8b1ffb9b0e14 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:36.030731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6b93abfc-d7c6-4a1b-ae8c-8b1ffb9b0e14 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:36.041779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6b93abfc-d7c6-4a1b-ae8c-8b1ffb9b0e14 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:36.042295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6b93abfc-d7c6-4a1b-ae8c-8b1ffb9b0e14 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:36.049718 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6b93abfc-d7c6-4a1b-ae8c-8b1ffb9b0e14 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:36.050824 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6b93abfc-d7c6-4a1b-ae8c-8b1ffb9b0e14 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:36.231375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e51e5fe4-bf5f-4f22-ac9c-f45baaaa56af tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:36.262133 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e51e5fe4-bf5f-4f22-ac9c-f45baaaa56af tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 1.011668 May 16 15:15:36.297615 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 35/59] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:35 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:36.541379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1848868112", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a605965-a559-434b-a7bc-1500d5306bfd"}], "security_groups": [{"name": "tempest-securitygroup--456668319"}], "key_name": "tempest-keypair-1799433840", "user_data": "}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:36.758270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6b93abfc-d7c6-4a1b-ae8c-8b1ffb9b0e14 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:36.781875 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6b93abfc-d7c6-4a1b-ae8c-8b1ffb9b0e14 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.755702 May 16 15:15:36.784287 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 25/60] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:36 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:36.979438 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] validate_networks() for [('1a605965-a559-434b-a7bc-1500d5306bfd', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:37.280282 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-823c1d74-7cef-41a0-9857-2a23171e3abb tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:37.282388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-823c1d74-7cef-41a0-9857-2a23171e3abb tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:37.302764 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-823c1d74-7cef-41a0-9857-2a23171e3abb tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:37.307785 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-823c1d74-7cef-41a0-9857-2a23171e3abb tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.307785 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-823c1d74-7cef-41a0-9857-2a23171e3abb tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:37.307785 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-823c1d74-7cef-41a0-9857-2a23171e3abb tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.959058 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-823c1d74-7cef-41a0-9857-2a23171e3abb tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:37.969752 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-823c1d74-7cef-41a0-9857-2a23171e3abb tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.693155 May 16 15:15:37.970575 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 26/61] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:37 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:37.992647 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-68ef9c91-c7ad-460d-b57a-08336e16f895 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:37.993308 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-68ef9c91-c7ad-460d-b57a-08336e16f895 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:38.007840 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-68ef9c91-c7ad-460d-b57a-08336e16f895 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.008640 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-68ef9c91-c7ad-460d-b57a-08336e16f895 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.017488 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-68ef9c91-c7ad-460d-b57a-08336e16f895 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.017488 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-68ef9c91-c7ad-460d-b57a-08336e16f895 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.362493 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-68ef9c91-c7ad-460d-b57a-08336e16f895 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:38.393251 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-68ef9c91-c7ad-460d-b57a-08336e16f895 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.417741 May 16 15:15:38.395211 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 27/62] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:37 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:38.523179 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:38.524158 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:38.525374 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:38.525942 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:38.526531 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:38.542618 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.543034 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.546027 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.546684 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.572530 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:38.576862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for user d38cdf40e33b47d8aa79e029cded7503 and project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:38.598813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:38.598813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:38.770515 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dcc2a87d-f95d-4391-9ea3-80400942c670 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.233428 May 16 15:15:38.774983 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 36/63] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:15:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:15:38.785258 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-352f86d4-68b3-413c-bc8f-126f6f16da14 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:38.785876 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-352f86d4-68b3-413c-bc8f-126f6f16da14 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:38.922942 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-8482629b-d3f8-45d6-9a02-ded671d4bd6f req-0a207dda-bba6-42ab-ba62-38a43781aa82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "005c2b60-9000-4ab7-a297-367fe59e2dfb", "tag": "d8f457a8-ad98-4eee-b4ce-0e463130c421"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:38.950762 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-8482629b-d3f8-45d6-9a02-ded671d4bd6f req-0a207dda-bba6-42ab-ba62-38a43781aa82 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.951538 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-8482629b-d3f8-45d6-9a02-ded671d4bd6f req-0a207dda-bba6-42ab-ba62-38a43781aa82 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.961519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-352f86d4-68b3-413c-bc8f-126f6f16da14 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:38.968265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-352f86d4-68b3-413c-bc8f-126f6f16da14 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1242 microversion: 2.1 time: 0.186978 May 16 15:15:38.971413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 28/64] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:38 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1242 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:38.980693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-8482629b-d3f8-45d6-9a02-ded671d4bd6f req-0a207dda-bba6-42ab-ba62-38a43781aa82 service nova] Creating event network-changed:d8f457a8-ad98-4eee-b4ce-0e463130c421 for instance 005c2b60-9000-4ab7-a297-367fe59e2dfb on hv-cinder-84175 May 16 15:15:38.987259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-8482629b-d3f8-45d6-9a02-ded671d4bd6f req-0a207dda-bba6-42ab-ba62-38a43781aa82 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070099 May 16 15:15:38.993603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 37/65] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:39.000121 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b8b4dc3b-292e-4cb4-958c-d88fda630ec1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:39.000841 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b8b4dc3b-292e-4cb4-958c-d88fda630ec1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:39.010882 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8b4dc3b-292e-4cb4-958c-d88fda630ec1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.011533 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8b4dc3b-292e-4cb4-958c-d88fda630ec1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.012836 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8b4dc3b-292e-4cb4-958c-d88fda630ec1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.013513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8b4dc3b-292e-4cb4-958c-d88fda630ec1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.267447 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b8b4dc3b-292e-4cb4-958c-d88fda630ec1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:39.270311 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-1082a755-3ecb-4659-b2a3-46d04624b2f7 req-be3ad8ef-8d30-4eea-a2d5-419d1352150d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c116f9-b96a-4690-9ebd-8ceb7f806e18", "tag": "0605d368-ac3c-4f23-b5ff-e1c7656542f5"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:39.276726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b8b4dc3b-292e-4cb4-958c-d88fda630ec1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.281671 May 16 15:15:39.277316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 38/66] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:38 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:39.291183 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-373405685", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92826b7c-8754-4fc6-b45f-5923507414b1"}], "security_groups": [{"name": "tempest-securitygroup--1784449730"}], "key_name": "tempest-keypair-758959174", "user_data": "}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:39.300760 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1082a755-3ecb-4659-b2a3-46d04624b2f7 req-be3ad8ef-8d30-4eea-a2d5-419d1352150d service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.303239 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1082a755-3ecb-4659-b2a3-46d04624b2f7 req-be3ad8ef-8d30-4eea-a2d5-419d1352150d service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.327029 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-1082a755-3ecb-4659-b2a3-46d04624b2f7 req-be3ad8ef-8d30-4eea-a2d5-419d1352150d service nova] Creating event network-changed:0605d368-ac3c-4f23-b5ff-e1c7656542f5 for instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 on hv-cinder-84175 May 16 15:15:39.327574 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1082a755-3ecb-4659-b2a3-46d04624b2f7 req-be3ad8ef-8d30-4eea-a2d5-419d1352150d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117677) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 15:15:39.328874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-158928d6-152a-414f-96b2-ab021084b8bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.329491 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-158928d6-152a-414f-96b2-ab021084b8bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.330580 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-158928d6-152a-414f-96b2-ab021084b8bb None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.331159 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-158928d6-152a-414f-96b2-ab021084b8bb None None] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.341584 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.compute.rpcapi [None req-158928d6-152a-414f-96b2-ab021084b8bb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 15:15:39.342473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-158928d6-152a-414f-96b2-ab021084b8bb None None] Releasing lock "compute-rpcapi-router" {{(pid=117677) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 15:15:39.363822 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-158928d6-152a-414f-96b2-ab021084b8bb None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.388676 May 16 15:15:39.365386 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 29/67] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:39.412570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-29c5e0d8-a595-4368-af19-8fcb98fa628d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:39.413537 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-29c5e0d8-a595-4368-af19-8fcb98fa628d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:39.421483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] validate_networks() for [('92826b7c-8754-4fc6-b45f-5923507414b1', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:39.429362 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-29c5e0d8-a595-4368-af19-8fcb98fa628d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.429821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-29c5e0d8-a595-4368-af19-8fcb98fa628d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.432726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-29c5e0d8-a595-4368-af19-8fcb98fa628d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.432726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-29c5e0d8-a595-4368-af19-8fcb98fa628d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.652680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-29c5e0d8-a595-4368-af19-8fcb98fa628d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:39.662185 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-29c5e0d8-a595-4368-af19-8fcb98fa628d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.254076 May 16 15:15:39.662770 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 30/68] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:39 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:39.922728 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:39.923211 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:39.923715 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:39.924122 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:39.924872 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:39.933825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.934270 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.935173 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.935594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.954173 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Getting quotas for project 64990eb359b54b0a8636a6e7619800a7. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:39.958610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Getting quotas for user 7b559cc982a846bea7f7f2077b7c455b and project 64990eb359b54b0a8636a6e7619800a7. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:39.970346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:39.973475 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:39.988831 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-906b9a5f-3dcc-4568-859a-d7f6045b35cc tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:39.989718 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-906b9a5f-3dcc-4568-859a-d7f6045b35cc tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:40.058879 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-906b9a5f-3dcc-4568-859a-d7f6045b35cc tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.067737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-906b9a5f-3dcc-4568-859a-d7f6045b35cc tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1242 microversion: 2.1 time: 0.081174 May 16 15:15:40.068944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 31/69] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:39 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:40.221672 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-bc60a5d7-b95c-4587-b373-66e6f560858a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.943075 May 16 15:15:40.223444 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 39/70] 10.222.0.71 () {62 vars in 1187 bytes} [Mon May 16 15:15:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 15:15:40.236899 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a5611e14-e7c9-420e-a48d-7c286ffeed74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:40.237478 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a5611e14-e7c9-420e-a48d-7c286ffeed74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:40.296192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-aa8511ac-af64-4ee5-b18a-efeb32c2ab16 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:40.296808 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-aa8511ac-af64-4ee5-b18a-efeb32c2ab16 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:40.322551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-aa8511ac-af64-4ee5-b18a-efeb32c2ab16 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.323920 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-aa8511ac-af64-4ee5-b18a-efeb32c2ab16 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.324914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-aa8511ac-af64-4ee5-b18a-efeb32c2ab16 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.326828 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-aa8511ac-af64-4ee5-b18a-efeb32c2ab16 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.340106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a5611e14-e7c9-420e-a48d-7c286ffeed74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.351017 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a5611e14-e7c9-420e-a48d-7c286ffeed74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.353903 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a5611e14-e7c9-420e-a48d-7c286ffeed74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.355694 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a5611e14-e7c9-420e-a48d-7c286ffeed74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1280 microversion: 2.20 time: 0.126188 May 16 15:15:40.356344 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 32/71] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:40 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:40.562589 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-aa8511ac-af64-4ee5-b18a-efeb32c2ab16 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.573823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-aa8511ac-af64-4ee5-b18a-efeb32c2ab16 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.281220 May 16 15:15:40.584938 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 40/72] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:40 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:40.680054 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3bf68df2-60ec-44c5-8d10-f560e730703b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:40.681452 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3bf68df2-60ec-44c5-8d10-f560e730703b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:40.688955 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3bf68df2-60ec-44c5-8d10-f560e730703b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.689928 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3bf68df2-60ec-44c5-8d10-f560e730703b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.697412 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3bf68df2-60ec-44c5-8d10-f560e730703b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.697412 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3bf68df2-60ec-44c5-8d10-f560e730703b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.866136 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3bf68df2-60ec-44c5-8d10-f560e730703b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.874293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3bf68df2-60ec-44c5-8d10-f560e730703b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.199018 May 16 15:15:40.875400 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 33/73] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:40 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:41.084078 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1005cb3a-0845-4f1b-8cc1-da4a7d70261e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:41.085316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1005cb3a-0845-4f1b-8cc1-da4a7d70261e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:41.092110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1005cb3a-0845-4f1b-8cc1-da4a7d70261e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.092633 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1005cb3a-0845-4f1b-8cc1-da4a7d70261e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.093582 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1005cb3a-0845-4f1b-8cc1-da4a7d70261e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.094132 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1005cb3a-0845-4f1b-8cc1-da4a7d70261e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.207258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1005cb3a-0845-4f1b-8cc1-da4a7d70261e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:41.219618 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1005cb3a-0845-4f1b-8cc1-da4a7d70261e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1246 microversion: 2.1 time: 0.139407 May 16 15:15:41.224622 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 41/74] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:41 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1246 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:41.380623 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-082305e3-d946-4357-a746-d8fcd9bd23b6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:41.381597 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-082305e3-d946-4357-a746-d8fcd9bd23b6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:41.473736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-082305e3-d946-4357-a746-d8fcd9bd23b6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:41.484729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-082305e3-d946-4357-a746-d8fcd9bd23b6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:41.487224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-082305e3-d946-4357-a746-d8fcd9bd23b6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:41.489871 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-082305e3-d946-4357-a746-d8fcd9bd23b6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1280 microversion: 2.20 time: 0.119066 May 16 15:15:41.490470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 34/75] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:41 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1280 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:41.598722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b0cf9ed0-1c89-4920-987b-9ee2e1f3218a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:41.599854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b0cf9ed0-1c89-4920-987b-9ee2e1f3218a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:41.617446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b0cf9ed0-1c89-4920-987b-9ee2e1f3218a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.622747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b0cf9ed0-1c89-4920-987b-9ee2e1f3218a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.629650 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b0cf9ed0-1c89-4920-987b-9ee2e1f3218a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.630419 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b0cf9ed0-1c89-4920-987b-9ee2e1f3218a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.895498 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-de2e99a4-954a-4d92-a72e-d21e17cb9e8d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:41.896160 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-de2e99a4-954a-4d92-a72e-d21e17cb9e8d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:41.920875 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-de2e99a4-954a-4d92-a72e-d21e17cb9e8d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.921331 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-de2e99a4-954a-4d92-a72e-d21e17cb9e8d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.922135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-de2e99a4-954a-4d92-a72e-d21e17cb9e8d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.922589 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-de2e99a4-954a-4d92-a72e-d21e17cb9e8d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.126648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b0cf9ed0-1c89-4920-987b-9ee2e1f3218a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.139020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b0cf9ed0-1c89-4920-987b-9ee2e1f3218a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 1.550712 May 16 15:15:43.139617 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 42/76] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:41 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:43.148100 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e8e8d1bc-4ec1-4153-a419-dd5822c1d3c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:43.148930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e8e8d1bc-4ec1-4153-a419-dd5822c1d3c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:43.155475 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e8e8d1bc-4ec1-4153-a419-dd5822c1d3c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.160155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e8e8d1bc-4ec1-4153-a419-dd5822c1d3c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.160155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e8e8d1bc-4ec1-4153-a419-dd5822c1d3c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.160155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e8e8d1bc-4ec1-4153-a419-dd5822c1d3c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.174444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-de2e99a4-954a-4d92-a72e-d21e17cb9e8d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.190308 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-de2e99a4-954a-4d92-a72e-d21e17cb9e8d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 1.302161 May 16 15:15:43.200256 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 35/77] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:41 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:43.201413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:43.202039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:43.218721 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.218912 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.224464 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.224947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.346745 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e8e8d1bc-4ec1-4153-a419-dd5822c1d3c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.355896 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e8e8d1bc-4ec1-4153-a419-dd5822c1d3c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1294 microversion: 2.1 time: 0.214747 May 16 15:15:43.357018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 43/78] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:43 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1294 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:43.395981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.413940 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.415807 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.417210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0372e1c7-46dd-4b4f-8f8d-354de4c685dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1276 microversion: 2.20 time: 0.219931 May 16 15:15:43.426116 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 36/79] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:43 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:44.156476 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a641046a-0bd5-4ac5-a364-4f4d4135adef tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:44.161717 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a641046a-0bd5-4ac5-a364-4f4d4135adef tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:44.167484 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a641046a-0bd5-4ac5-a364-4f4d4135adef tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.168060 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a641046a-0bd5-4ac5-a364-4f4d4135adef tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.169005 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a641046a-0bd5-4ac5-a364-4f4d4135adef tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.169514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a641046a-0bd5-4ac5-a364-4f4d4135adef tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.208803 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e857cdef-8473-48ce-9413-f6eec9f6f8d1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:44.209520 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e857cdef-8473-48ce-9413-f6eec9f6f8d1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:44.215668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e857cdef-8473-48ce-9413-f6eec9f6f8d1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.216119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e857cdef-8473-48ce-9413-f6eec9f6f8d1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.216936 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e857cdef-8473-48ce-9413-f6eec9f6f8d1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.217407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e857cdef-8473-48ce-9413-f6eec9f6f8d1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.344477 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a641046a-0bd5-4ac5-a364-4f4d4135adef tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.353035 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a641046a-0bd5-4ac5-a364-4f4d4135adef tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.200395 May 16 15:15:44.363513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 44/80] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:44 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:44.377158 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0c9e5db1-5a67-4e82-968f-4bf55ac1b960 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:44.377888 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0c9e5db1-5a67-4e82-968f-4bf55ac1b960 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:44.396278 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c9e5db1-5a67-4e82-968f-4bf55ac1b960 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.397375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c9e5db1-5a67-4e82-968f-4bf55ac1b960 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.404647 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c9e5db1-5a67-4e82-968f-4bf55ac1b960 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.405225 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c9e5db1-5a67-4e82-968f-4bf55ac1b960 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.459338 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e857cdef-8473-48ce-9413-f6eec9f6f8d1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.470281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e857cdef-8473-48ce-9413-f6eec9f6f8d1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.263865 May 16 15:15:44.470891 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 37/81] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:44 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:44.483808 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:44.484613 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:44.496522 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.500088 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.500476 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.500925 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.627724 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0c9e5db1-5a67-4e82-968f-4bf55ac1b960 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.635669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0c9e5db1-5a67-4e82-968f-4bf55ac1b960 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1312 microversion: 2.1 time: 0.262547 May 16 15:15:44.636343 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 45/82] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:44 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:44.673817 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.684271 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.685757 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.687187 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c92fbe5c-1f7c-4aa4-8672-23c4b7b42691 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1332 microversion: 2.20 time: 0.212501 May 16 15:15:44.687745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 38/83] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:44 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1332 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:45.370184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1f6544fa-fbda-4f69-9983-1cd8eba658c9 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:45.371432 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1f6544fa-fbda-4f69-9983-1cd8eba658c9 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:45.384184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1f6544fa-fbda-4f69-9983-1cd8eba658c9 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.384184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1f6544fa-fbda-4f69-9983-1cd8eba658c9 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:45.384184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1f6544fa-fbda-4f69-9983-1cd8eba658c9 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.384184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1f6544fa-fbda-4f69-9983-1cd8eba658c9 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:45.490147 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f84eac52-b4c9-4fd6-b663-b8d379fdc346 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:45.491758 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f84eac52-b4c9-4fd6-b663-b8d379fdc346 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:45.504001 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f84eac52-b4c9-4fd6-b663-b8d379fdc346 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.504622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f84eac52-b4c9-4fd6-b663-b8d379fdc346 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:45.505593 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f84eac52-b4c9-4fd6-b663-b8d379fdc346 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.506030 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f84eac52-b4c9-4fd6-b663-b8d379fdc346 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.157802 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1f6544fa-fbda-4f69-9983-1cd8eba658c9 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.167233 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1f6544fa-fbda-4f69-9983-1cd8eba658c9 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.800850 May 16 15:15:46.167997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 46/84] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:45 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:46.173378 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-510b0aa5-05a6-456e-ab6e-b5c60a3a38c2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:46.174650 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-510b0aa5-05a6-456e-ab6e-b5c60a3a38c2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:46.182516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-510b0aa5-05a6-456e-ab6e-b5c60a3a38c2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.183331 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-510b0aa5-05a6-456e-ab6e-b5c60a3a38c2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.184134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-510b0aa5-05a6-456e-ab6e-b5c60a3a38c2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.184844 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-510b0aa5-05a6-456e-ab6e-b5c60a3a38c2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.312819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f84eac52-b4c9-4fd6-b663-b8d379fdc346 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.322557 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f84eac52-b4c9-4fd6-b663-b8d379fdc346 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.837121 May 16 15:15:46.341909 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 39/85] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:45 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:46.346423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:46.347621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:46.353955 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.354398 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.355343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.356157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.460238 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.468737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.470660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.471331 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a6685f98-2c4f-4c24-ae4a-958dc4dc101a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1338 microversion: 2.20 time: 0.128669 May 16 15:15:46.472239 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 40/86] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:46 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1338 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:46.553122 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-510b0aa5-05a6-456e-ab6e-b5c60a3a38c2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.562393 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-510b0aa5-05a6-456e-ab6e-b5c60a3a38c2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.393092 May 16 15:15:46.562967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 47/87] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:46 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:47.185286 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-fd8e313b-a81e-4964-adbb-cc7d941f39e1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:47.186563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-fd8e313b-a81e-4964-adbb-cc7d941f39e1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:47.194329 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fd8e313b-a81e-4964-adbb-cc7d941f39e1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.199579 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fd8e313b-a81e-4964-adbb-cc7d941f39e1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.199579 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fd8e313b-a81e-4964-adbb-cc7d941f39e1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.199579 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fd8e313b-a81e-4964-adbb-cc7d941f39e1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.348902 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-509f91c3-008d-47b2-b0f9-7544cfd0cb0c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:47.350766 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-509f91c3-008d-47b2-b0f9-7544cfd0cb0c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:47.358964 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-509f91c3-008d-47b2-b0f9-7544cfd0cb0c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.359590 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-509f91c3-008d-47b2-b0f9-7544cfd0cb0c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.360510 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-509f91c3-008d-47b2-b0f9-7544cfd0cb0c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.367470 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-509f91c3-008d-47b2-b0f9-7544cfd0cb0c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.585225 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-fd8e313b-a81e-4964-adbb-cc7d941f39e1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.599937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-fd8e313b-a81e-4964-adbb-cc7d941f39e1 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.418613 May 16 15:15:47.601322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 41/88] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:47 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:47.609457 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:47.610869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:47.621912 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.623947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.626525 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.626525 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.742304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.754721 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.758388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.759896 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-45518135-d599-4030-87fe-718fa0a65ea1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1338 microversion: 2.20 time: 0.156934 May 16 15:15:47.763735 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 42/89] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:47 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1338 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:47.768655 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-cb28825e-d57b-43eb-8079-8438bee28a10 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:47.769504 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cb28825e-d57b-43eb-8079-8438bee28a10 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:47.786769 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cb28825e-d57b-43eb-8079-8438bee28a10 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.787520 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cb28825e-d57b-43eb-8079-8438bee28a10 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.788294 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cb28825e-d57b-43eb-8079-8438bee28a10 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.788728 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cb28825e-d57b-43eb-8079-8438bee28a10 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.795816 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-509f91c3-008d-47b2-b0f9-7544cfd0cb0c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.811563 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-509f91c3-008d-47b2-b0f9-7544cfd0cb0c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.472034 May 16 15:15:47.820694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 48/90] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:47 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:48.015664 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-2eeebf4b-0d95-4e32-b985-b8c12843eefc req-780e2261-4ca5-4036-99f0-f56031a3cac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b1e4cf-ff7e-43d2-9351-ca6206651db4", "tag": "9d2d9f44-9262-4053-b198-1c13754b68fd"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:48.024746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2eeebf4b-0d95-4e32-b985-b8c12843eefc req-780e2261-4ca5-4036-99f0-f56031a3cac6 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.025197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2eeebf4b-0d95-4e32-b985-b8c12843eefc req-780e2261-4ca5-4036-99f0-f56031a3cac6 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.038083 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-2eeebf4b-0d95-4e32-b985-b8c12843eefc req-780e2261-4ca5-4036-99f0-f56031a3cac6 service nova] Creating event network-changed:9d2d9f44-9262-4053-b198-1c13754b68fd for instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 on hv-cinder-84175 May 16 15:15:48.043140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-2eeebf4b-0d95-4e32-b985-b8c12843eefc req-780e2261-4ca5-4036-99f0-f56031a3cac6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032126 May 16 15:15:48.044108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 49/91] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:48.241073 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-cb28825e-d57b-43eb-8079-8438bee28a10 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:48.249151 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-cb28825e-d57b-43eb-8079-8438bee28a10 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.484156 May 16 15:15:48.255310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 43/92] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:47 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:48.618270 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dc1b13ff-bc0c-4631-8f7d-24ee5af292da tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:48.619072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dc1b13ff-bc0c-4631-8f7d-24ee5af292da tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:48.627302 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dc1b13ff-bc0c-4631-8f7d-24ee5af292da tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.627836 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dc1b13ff-bc0c-4631-8f7d-24ee5af292da tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.628787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dc1b13ff-bc0c-4631-8f7d-24ee5af292da tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.629300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dc1b13ff-bc0c-4631-8f7d-24ee5af292da tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.786110 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:48.786730 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:48.793995 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.794303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.795682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.795682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.883268 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:48.887390 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dc1b13ff-bc0c-4631-8f7d-24ee5af292da tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:48.891582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:48.893105 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:48.894400 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2f163fcc-cf30-487b-bf22-724b0ce74177 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1338 microversion: 2.20 time: 0.118477 May 16 15:15:48.894717 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dc1b13ff-bc0c-4631-8f7d-24ee5af292da tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.281368 May 16 15:15:48.895572 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 50/93] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:48 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:48.898420 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 44/94] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:48 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1338 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:15:48.902601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-864bcb64-1b46-4695-afce-fc9974075e5b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:48.903516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-864bcb64-1b46-4695-afce-fc9974075e5b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:48.909960 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-864bcb64-1b46-4695-afce-fc9974075e5b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.910406 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-864bcb64-1b46-4695-afce-fc9974075e5b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.911178 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-864bcb64-1b46-4695-afce-fc9974075e5b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.911610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-864bcb64-1b46-4695-afce-fc9974075e5b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.276339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9f40506c-319c-4002-9589-33a3356d7a96 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:49.277377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9f40506c-319c-4002-9589-33a3356d7a96 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:49.296755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9f40506c-319c-4002-9589-33a3356d7a96 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.297271 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9f40506c-319c-4002-9589-33a3356d7a96 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.302376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9f40506c-319c-4002-9589-33a3356d7a96 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.302376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9f40506c-319c-4002-9589-33a3356d7a96 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.487976 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-864bcb64-1b46-4695-afce-fc9974075e5b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:49.506156 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-864bcb64-1b46-4695-afce-fc9974075e5b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.605695 May 16 15:15:49.509979 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 51/95] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:48 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:49.687030 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9f40506c-319c-4002-9589-33a3356d7a96 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:49.698368 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9f40506c-319c-4002-9589-33a3356d7a96 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.434011 May 16 15:15:49.719964 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 45/96] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:49 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:49.889507 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-70849aee-ab59-455e-b7df-573b499723cc req-91ac6ad2-994c-45ec-b325-f4d02d1a09f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c247c0bb-0802-47bf-8790-6d17eb129c28", "name": "network-vif-plugged", "status": "completed", "tag": "01d8431d-7010-47b2-8c50-59586072403b"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:49.901523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-70849aee-ab59-455e-b7df-573b499723cc req-91ac6ad2-994c-45ec-b325-f4d02d1a09f3 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.901523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-70849aee-ab59-455e-b7df-573b499723cc req-91ac6ad2-994c-45ec-b325-f4d02d1a09f3 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.913187 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c294bfaa-d2ae-4e96-9e0f-302d83138a17 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:49.914177 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c294bfaa-d2ae-4e96-9e0f-302d83138a17 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:49.919140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-70849aee-ab59-455e-b7df-573b499723cc req-91ac6ad2-994c-45ec-b325-f4d02d1a09f3 service nova] Creating event network-vif-plugged:01d8431d-7010-47b2-8c50-59586072403b for instance c247c0bb-0802-47bf-8790-6d17eb129c28 on hv-cinder-84175 May 16 15:15:49.921475 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c294bfaa-d2ae-4e96-9e0f-302d83138a17 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.921947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c294bfaa-d2ae-4e96-9e0f-302d83138a17 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.923424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c294bfaa-d2ae-4e96-9e0f-302d83138a17 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.924217 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c294bfaa-d2ae-4e96-9e0f-302d83138a17 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.924878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-70849aee-ab59-455e-b7df-573b499723cc req-91ac6ad2-994c-45ec-b325-f4d02d1a09f3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253381 May 16 15:15:49.926111 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 52/97] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:49.932734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:49.933329 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:49.941503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.942015 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.943236 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.943871 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.381761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c294bfaa-d2ae-4e96-9e0f-302d83138a17 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:50.390105 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c294bfaa-d2ae-4e96-9e0f-302d83138a17 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.482783 May 16 15:15:50.396683 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 46/98] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:49 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:50.475674 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:50.484766 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:50.486456 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:50.487892 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4c57db8e-d4ac-4f40-b5a3-4c1af978aa29 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.560562 May 16 15:15:50.498447 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 53/99] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:49 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:50.527320 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-97de5abc-63a6-4b63-b550-354565e08811 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:50.528350 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-97de5abc-63a6-4b63-b550-354565e08811 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:50.536332 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-97de5abc-63a6-4b63-b550-354565e08811 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.537508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-97de5abc-63a6-4b63-b550-354565e08811 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.538721 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-97de5abc-63a6-4b63-b550-354565e08811 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.539378 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-97de5abc-63a6-4b63-b550-354565e08811 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.723595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-687164f0-06f5-4852-a2c7-c21d689183e9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:50.724437 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-687164f0-06f5-4852-a2c7-c21d689183e9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:50.731313 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-687164f0-06f5-4852-a2c7-c21d689183e9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.734214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-687164f0-06f5-4852-a2c7-c21d689183e9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.734214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-687164f0-06f5-4852-a2c7-c21d689183e9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.734214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-687164f0-06f5-4852-a2c7-c21d689183e9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.924650 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-97de5abc-63a6-4b63-b550-354565e08811 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:50.943247 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-97de5abc-63a6-4b63-b550-354565e08811 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.417761 May 16 15:15:50.952135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 47/100] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:50 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:51.043349 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-687164f0-06f5-4852-a2c7-c21d689183e9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.052827 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-687164f0-06f5-4852-a2c7-c21d689183e9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.333645 May 16 15:15:51.054478 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 54/101] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:50 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:51.412905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a62bb0c5-97dd-43d1-939f-7c643c83291d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:51.414317 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a62bb0c5-97dd-43d1-939f-7c643c83291d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:51.421706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a62bb0c5-97dd-43d1-939f-7c643c83291d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.422156 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a62bb0c5-97dd-43d1-939f-7c643c83291d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.428162 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a62bb0c5-97dd-43d1-939f-7c643c83291d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.432563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a62bb0c5-97dd-43d1-939f-7c643c83291d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.507185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:51.509486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:51.519847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.520674 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.522486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.526176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.666799 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a62bb0c5-97dd-43d1-939f-7c643c83291d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.679358 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a62bb0c5-97dd-43d1-939f-7c643c83291d tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.270180 May 16 15:15:51.680327 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 48/102] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:51 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:51.775329 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-af147a0d-694a-4156-a3d0-90864e0509a8 req-a5bce49b-8ebb-48c6-9eee-c44630e8eaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893feede-4052-4c51-96a2-1f93510d1f5f", "tag": "7be8453f-3109-4b92-981a-837b09373d42"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:51.788419 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.789313 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-af147a0d-694a-4156-a3d0-90864e0509a8 req-a5bce49b-8ebb-48c6-9eee-c44630e8eaf7 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.789772 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-af147a0d-694a-4156-a3d0-90864e0509a8 req-a5bce49b-8ebb-48c6-9eee-c44630e8eaf7 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.802518 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.804483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.806030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0866421c-fe5e-4ed1-96a2-2ee0774a12d0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.304310 May 16 15:15:51.807051 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 55/103] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:51 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:51.814729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-af147a0d-694a-4156-a3d0-90864e0509a8 req-a5bce49b-8ebb-48c6-9eee-c44630e8eaf7 service nova] Creating event network-changed:7be8453f-3109-4b92-981a-837b09373d42 for instance 893feede-4052-4c51-96a2-1f93510d1f5f on hv-cinder-84175 May 16 15:15:51.822343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-af147a0d-694a-4156-a3d0-90864e0509a8 req-a5bce49b-8ebb-48c6-9eee-c44630e8eaf7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050915 May 16 15:15:51.823280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 49/104] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:51.951507 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-2c4233e0-d535-4622-9568-8fba043b1098 req-b7657132-f22a-4672-816c-76978f6e0537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c116f9-b96a-4690-9ebd-8ceb7f806e18", "name": "network-vif-plugged", "status": "completed", "tag": "0605d368-ac3c-4f23-b5ff-e1c7656542f5"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:51.966746 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3c52cf4f-02e8-4f3f-83e0-ff5637fc9f97 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:51.967523 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3c52cf4f-02e8-4f3f-83e0-ff5637fc9f97 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:51.968967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2c4233e0-d535-4622-9568-8fba043b1098 req-b7657132-f22a-4672-816c-76978f6e0537 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.971484 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2c4233e0-d535-4622-9568-8fba043b1098 req-b7657132-f22a-4672-816c-76978f6e0537 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.976820 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3c52cf4f-02e8-4f3f-83e0-ff5637fc9f97 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.977278 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3c52cf4f-02e8-4f3f-83e0-ff5637fc9f97 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.978054 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3c52cf4f-02e8-4f3f-83e0-ff5637fc9f97 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.980937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3c52cf4f-02e8-4f3f-83e0-ff5637fc9f97 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.983169 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-2c4233e0-d535-4622-9568-8fba043b1098 req-b7657132-f22a-4672-816c-76978f6e0537 service nova] Creating event network-vif-plugged:0605d368-ac3c-4f23-b5ff-e1c7656542f5 for instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 on hv-cinder-84175 May 16 15:15:51.989004 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-2c4233e0-d535-4622-9568-8fba043b1098 req-b7657132-f22a-4672-816c-76978f6e0537 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050814 May 16 15:15:51.993306 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 56/105] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:52.072251 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2a5a9d1d-a544-454d-97bf-728b8e25d5ed tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:52.073648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2a5a9d1d-a544-454d-97bf-728b8e25d5ed tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:52.081855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2a5a9d1d-a544-454d-97bf-728b8e25d5ed tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.082821 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2a5a9d1d-a544-454d-97bf-728b8e25d5ed tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.083829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2a5a9d1d-a544-454d-97bf-728b8e25d5ed tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.084574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2a5a9d1d-a544-454d-97bf-728b8e25d5ed tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.144517 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3c52cf4f-02e8-4f3f-83e0-ff5637fc9f97 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:52.156181 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3c52cf4f-02e8-4f3f-83e0-ff5637fc9f97 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.194103 May 16 15:15:52.156785 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 50/106] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:51 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:52.361867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2a5a9d1d-a544-454d-97bf-728b8e25d5ed tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:52.369511 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2a5a9d1d-a544-454d-97bf-728b8e25d5ed tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.301590 May 16 15:15:52.373471 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 57/107] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:52 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:52.706287 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3c41a796-2e68-4e14-ab5a-675f66181f0e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:52.708370 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3c41a796-2e68-4e14-ab5a-675f66181f0e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:52.727110 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3c41a796-2e68-4e14-ab5a-675f66181f0e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.727589 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3c41a796-2e68-4e14-ab5a-675f66181f0e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.730054 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3c41a796-2e68-4e14-ab5a-675f66181f0e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.730508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3c41a796-2e68-4e14-ab5a-675f66181f0e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.829373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:52.830214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:52.839890 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.840612 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.848666 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.849338 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.098255 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3c41a796-2e68-4e14-ab5a-675f66181f0e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.111107 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3c41a796-2e68-4e14-ab5a-675f66181f0e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1315 microversion: 2.1 time: 0.413124 May 16 15:15:53.111833 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 51/108] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:52 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:53.137213 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.145271 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.147736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.148960 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f581e565-c929-4cd9-8bd1-f284ccbb2e79 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.323725 May 16 15:15:53.149830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 58/109] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:52 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:15:53.178133 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d645bc20-963f-40cd-a78d-cb039ce587be tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:53.178892 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d645bc20-963f-40cd-a78d-cb039ce587be tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:53.185192 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d645bc20-963f-40cd-a78d-cb039ce587be tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.185985 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d645bc20-963f-40cd-a78d-cb039ce587be tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.186990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d645bc20-963f-40cd-a78d-cb039ce587be tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.187939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d645bc20-963f-40cd-a78d-cb039ce587be tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.337936 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d645bc20-963f-40cd-a78d-cb039ce587be tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.345216 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d645bc20-963f-40cd-a78d-cb039ce587be tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.174633 May 16 15:15:53.345776 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 52/110] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:53 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:53.391154 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4b21e4f1-13ca-424a-b3f9-9b36536676e0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:53.391826 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4b21e4f1-13ca-424a-b3f9-9b36536676e0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:53.401401 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f1-13ca-424a-b3f9-9b36536676e0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.409886 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f1-13ca-424a-b3f9-9b36536676e0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.413222 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f1-13ca-424a-b3f9-9b36536676e0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.418126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f1-13ca-424a-b3f9-9b36536676e0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.573315 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4b21e4f1-13ca-424a-b3f9-9b36536676e0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.580516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4b21e4f1-13ca-424a-b3f9-9b36536676e0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.193146 May 16 15:15:53.581114 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 59/111] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:53 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:54.003798 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-f0e51df0-9e02-4701-a234-ef1b5dab85f7 req-a37e850c-d921-4536-b449-e7cfa4637adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "005c2b60-9000-4ab7-a297-367fe59e2dfb", "name": "network-vif-plugged", "status": "completed", "tag": "d8f457a8-ad98-4eee-b4ce-0e463130c421"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:54.011575 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-f0e51df0-9e02-4701-a234-ef1b5dab85f7 req-a37e850c-d921-4536-b449-e7cfa4637adc service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.015802 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-f0e51df0-9e02-4701-a234-ef1b5dab85f7 req-a37e850c-d921-4536-b449-e7cfa4637adc service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.024761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-f0e51df0-9e02-4701-a234-ef1b5dab85f7 req-a37e850c-d921-4536-b449-e7cfa4637adc service nova] Creating event network-vif-plugged:d8f457a8-ad98-4eee-b4ce-0e463130c421 for instance 005c2b60-9000-4ab7-a297-367fe59e2dfb on hv-cinder-84175 May 16 15:15:54.034317 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-f0e51df0-9e02-4701-a234-ef1b5dab85f7 req-a37e850c-d921-4536-b449-e7cfa4637adc service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033697 May 16 15:15:54.039382 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 53/112] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:54.128555 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0980947b-bea6-4581-9e9c-2198462d2c19 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:54.129173 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0980947b-bea6-4581-9e9c-2198462d2c19 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:54.135032 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0980947b-bea6-4581-9e9c-2198462d2c19 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.135471 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0980947b-bea6-4581-9e9c-2198462d2c19 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.136259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0980947b-bea6-4581-9e9c-2198462d2c19 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.136685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0980947b-bea6-4581-9e9c-2198462d2c19 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.169125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:54.170038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:54.177110 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.177763 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.178642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.179136 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.347373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0980947b-bea6-4581-9e9c-2198462d2c19 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:54.355472 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0980947b-bea6-4581-9e9c-2198462d2c19 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1501 microversion: 2.1 time: 0.231298 May 16 15:15:54.356083 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 60/113] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:54 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:54.361810 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-21461f50-6fc3-4805-b98f-e6c73dcab29d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:54.362475 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-21461f50-6fc3-4805-b98f-e6c73dcab29d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:54.368707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-21461f50-6fc3-4805-b98f-e6c73dcab29d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.369356 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-21461f50-6fc3-4805-b98f-e6c73dcab29d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.370316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-21461f50-6fc3-4805-b98f-e6c73dcab29d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.370903 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-21461f50-6fc3-4805-b98f-e6c73dcab29d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.381045 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:54.389731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:54.391515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:54.392772 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1224d945-78f4-42a9-b0e2-2631cc2d1ce8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.228059 May 16 15:15:54.395675 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 54/114] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:54 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:54.603101 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2a7e0df5-0a78-4997-8c71-3fe59f1ce333 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:54.607793 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2a7e0df5-0a78-4997-8c71-3fe59f1ce333 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:54.635403 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2a7e0df5-0a78-4997-8c71-3fe59f1ce333 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.635889 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2a7e0df5-0a78-4997-8c71-3fe59f1ce333 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.636693 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2a7e0df5-0a78-4997-8c71-3fe59f1ce333 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.637349 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2a7e0df5-0a78-4997-8c71-3fe59f1ce333 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:55.044329 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-21461f50-6fc3-4805-b98f-e6c73dcab29d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.063934 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-21461f50-6fc3-4805-b98f-e6c73dcab29d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1322 microversion: 2.1 time: 0.705027 May 16 15:15:55.067181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 61/115] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:54 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:55.200127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2a7e0df5-0a78-4997-8c71-3fe59f1ce333 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.213558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2a7e0df5-0a78-4997-8c71-3fe59f1ce333 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.614518 May 16 15:15:55.217278 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 55/116] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:54 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:55.412154 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:55.413332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:55.420741 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:55.421209 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:55.421987 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:55.422466 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:55.600789 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.608472 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.609939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.611212 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1819ed1f-1fae-4a03-b07f-3a1f095820d6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.203205 May 16 15:15:55.611780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 62/117] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:55 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:56.048895 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-fbc792ac-512a-4d76-8a34-57a18ec44f8e req-b1face2b-31ea-499e-a10c-d73340464ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b1e4cf-ff7e-43d2-9351-ca6206651db4", "name": "network-vif-plugged", "status": "completed", "tag": "9d2d9f44-9262-4053-b198-1c13754b68fd"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:56.057475 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-fbc792ac-512a-4d76-8a34-57a18ec44f8e req-b1face2b-31ea-499e-a10c-d73340464ed7 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.059598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-fbc792ac-512a-4d76-8a34-57a18ec44f8e req-b1face2b-31ea-499e-a10c-d73340464ed7 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.069282 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-fbc792ac-512a-4d76-8a34-57a18ec44f8e req-b1face2b-31ea-499e-a10c-d73340464ed7 service nova] Creating event network-vif-plugged:9d2d9f44-9262-4053-b198-1c13754b68fd for instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 on hv-cinder-84175 May 16 15:15:56.074145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-fbc792ac-512a-4d76-8a34-57a18ec44f8e req-b1face2b-31ea-499e-a10c-d73340464ed7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028986 May 16 15:15:56.074714 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 56/118] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:56.084028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-114ca9fb-afb0-4feb-8b2a-e239a57ab909 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:56.084610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-114ca9fb-afb0-4feb-8b2a-e239a57ab909 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.090633 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-114ca9fb-afb0-4feb-8b2a-e239a57ab909 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.094028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-114ca9fb-afb0-4feb-8b2a-e239a57ab909 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.094028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-114ca9fb-afb0-4feb-8b2a-e239a57ab909 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.094028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-114ca9fb-afb0-4feb-8b2a-e239a57ab909 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.226652 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-114ca9fb-afb0-4feb-8b2a-e239a57ab909 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:56.234177 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-114ca9fb-afb0-4feb-8b2a-e239a57ab909 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1517 microversion: 2.1 time: 0.154963 May 16 15:15:56.234750 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 63/119] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:56 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:56.237058 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-536a302a-06d8-493a-badb-c98049d7fc88 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:56.238888 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-536a302a-06d8-493a-badb-c98049d7fc88 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.244927 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-536a302a-06d8-493a-badb-c98049d7fc88 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.245837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-536a302a-06d8-493a-badb-c98049d7fc88 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.246215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-536a302a-06d8-493a-badb-c98049d7fc88 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.246651 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-536a302a-06d8-493a-badb-c98049d7fc88 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.264684 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8b622168-9254-4b5b-a265-354ff4511ca4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:56.265941 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8b622168-9254-4b5b-a265-354ff4511ca4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.273424 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8b622168-9254-4b5b-a265-354ff4511ca4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.273867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8b622168-9254-4b5b-a265-354ff4511ca4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.275015 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8b622168-9254-4b5b-a265-354ff4511ca4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.275602 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8b622168-9254-4b5b-a265-354ff4511ca4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.346088 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-8b622168-9254-4b5b-a265-354ff4511ca4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lazy-loading 'flavor' on Instance uuid 04c116f9-b96a-4690-9ebd-8ceb7f806e18 {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:15:56.411622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-536a302a-06d8-493a-badb-c98049d7fc88 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:56.419871 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-536a302a-06d8-493a-badb-c98049d7fc88 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.188865 May 16 15:15:56.420798 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 57/120] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:56 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:56.484195 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4f626268-9049-400d-bf08-e6c9238925f3 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bac337c8-5b05-4ffb-9e95-6a1a931b59eb"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:56.485450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4f626268-9049-400d-bf08-e6c9238925f3 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.492525 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4f626268-9049-400d-bf08-e6c9238925f3 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.493021 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4f626268-9049-400d-bf08-e6c9238925f3 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.494186 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4f626268-9049-400d-bf08-e6c9238925f3 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.494624 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4f626268-9049-400d-bf08-e6c9238925f3 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.716308 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8b622168-9254-4b5b-a265-354ff4511ca4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18/action" status: 200 len: 32 microversion: 2.1 time: 0.455747 May 16 15:15:56.719938 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 64/121] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:15:56 2022] POST /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18/action => generated 32 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:15:56.724900 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:56.725814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.732346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.733051 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.733992 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.734579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.897099 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:56.906016 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:56.907501 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:56.908633 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-fcf4e715-7ccc-4f5d-bd01-6d26d38af8a5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.189813 May 16 15:15:56.910300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 65/122] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:56 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:56.916008 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6c5f4256-9266-4074-9dc0-6cba122ff38b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:56.916787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6c5f4256-9266-4074-9dc0-6cba122ff38b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.924561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c5f4256-9266-4074-9dc0-6cba122ff38b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.925812 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c5f4256-9266-4074-9dc0-6cba122ff38b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.927072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c5f4256-9266-4074-9dc0-6cba122ff38b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.927682 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c5f4256-9266-4074-9dc0-6cba122ff38b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.132128 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6c5f4256-9266-4074-9dc0-6cba122ff38b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:57.140472 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6c5f4256-9266-4074-9dc0-6cba122ff38b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.228996 May 16 15:15:57.154765 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 66/123] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:56 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:57.436597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4af85449-8d3c-4945-af1e-e67df7c8d129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:57.437215 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4af85449-8d3c-4945-af1e-e67df7c8d129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:57.443272 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4af85449-8d3c-4945-af1e-e67df7c8d129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.443748 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4af85449-8d3c-4945-af1e-e67df7c8d129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.451794 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4af85449-8d3c-4945-af1e-e67df7c8d129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.451794 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4af85449-8d3c-4945-af1e-e67df7c8d129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.651468 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4f626268-9049-400d-bf08-e6c9238925f3 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "POST /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.170986 May 16 15:15:57.658006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 58/124] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:15:56 2022] POST /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28/os-volume_attachments => generated 194 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:57.705975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4af85449-8d3c-4945-af1e-e67df7c8d129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:57.718339 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4af85449-8d3c-4945-af1e-e67df7c8d129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.284275 May 16 15:15:57.718953 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 67/125] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:57 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:57.927320 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:57.928323 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:57.941857 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.941857 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.941857 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.941857 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.089699 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:58.098444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:58.100257 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:58.101435 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-71702893-b591-4097-a3b2-009af1cdc7e3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.178509 May 16 15:15:58.101864 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 59/126] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:57 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:58.160497 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2667515e-0a0d-47ea-a512-881d5878acee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:58.161116 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2667515e-0a0d-47ea-a512-881d5878acee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:58.168812 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2667515e-0a0d-47ea-a512-881d5878acee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.169617 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2667515e-0a0d-47ea-a512-881d5878acee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.170600 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2667515e-0a0d-47ea-a512-881d5878acee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.171185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2667515e-0a0d-47ea-a512-881d5878acee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.328067 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2667515e-0a0d-47ea-a512-881d5878acee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:58.337778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2667515e-0a0d-47ea-a512-881d5878acee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.182052 May 16 15:15:58.338442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 68/127] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:58 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:58.735332 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f91aaf6b-6ac8-4a47-b0e9-d040efe0c442 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:58.736597 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f91aaf6b-6ac8-4a47-b0e9-d040efe0c442 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:58.743722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f91aaf6b-6ac8-4a47-b0e9-d040efe0c442 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.744357 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f91aaf6b-6ac8-4a47-b0e9-d040efe0c442 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.745276 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f91aaf6b-6ac8-4a47-b0e9-d040efe0c442 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.745855 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f91aaf6b-6ac8-4a47-b0e9-d040efe0c442 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.966656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f91aaf6b-6ac8-4a47-b0e9-d040efe0c442 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:58.976801 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f91aaf6b-6ac8-4a47-b0e9-d040efe0c442 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1367 microversion: 2.1 time: 0.245633 May 16 15:15:58.977589 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 60/128] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:58 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:59.126871 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:59.128407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:59.137769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:59.138224 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:59.139868 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:59.140597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:59.295371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:59.305349 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:59.307723 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:59.308528 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d40bac13-04a5-4027-a579-6801c503b7e5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.191520 May 16 15:15:59.309162 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 69/129] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:15:59 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:59.355533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-163c8ab8-2c79-4b77-9b99-c3723f7992c8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:59.356193 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-163c8ab8-2c79-4b77-9b99-c3723f7992c8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:59.363388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-163c8ab8-2c79-4b77-9b99-c3723f7992c8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:59.363872 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-163c8ab8-2c79-4b77-9b99-c3723f7992c8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:59.364645 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-163c8ab8-2c79-4b77-9b99-c3723f7992c8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:59.365130 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-163c8ab8-2c79-4b77-9b99-c3723f7992c8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:59.571469 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-163c8ab8-2c79-4b77-9b99-c3723f7992c8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:59.578812 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-163c8ab8-2c79-4b77-9b99-c3723f7992c8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.227416 May 16 15:15:59.579378 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 61/130] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:59 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:59.996651 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1fcba542-60c0-4cec-88ab-90665d5f3133 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:59.997811 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1fcba542-60c0-4cec-88ab-90665d5f3133 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:00.012543 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1fcba542-60c0-4cec-88ab-90665d5f3133 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.013599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1fcba542-60c0-4cec-88ab-90665d5f3133 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.014870 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1fcba542-60c0-4cec-88ab-90665d5f3133 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.015479 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1fcba542-60c0-4cec-88ab-90665d5f3133 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.170232 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1fcba542-60c0-4cec-88ab-90665d5f3133 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:00.178939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1fcba542-60c0-4cec-88ab-90665d5f3133 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1558 microversion: 2.1 time: 0.186264 May 16 15:16:00.179816 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 70/131] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:15:59 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:00.196884 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4f3a8c70-88e8-4981-ad8e-a6f41e473a92 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:00.197405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4f3a8c70-88e8-4981-ad8e-a6f41e473a92 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:00.203515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4f3a8c70-88e8-4981-ad8e-a6f41e473a92 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.204047 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4f3a8c70-88e8-4981-ad8e-a6f41e473a92 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.204750 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4f3a8c70-88e8-4981-ad8e-a6f41e473a92 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.205354 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4f3a8c70-88e8-4981-ad8e-a6f41e473a92 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.293405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4f3a8c70-88e8-4981-ad8e-a6f41e473a92 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098551 May 16 15:16:00.293405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 62/132] 10.222.0.71 () {58 vars in 1274 bytes} [Mon May 16 15:16:00 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:00.327587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:00.328238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:00.338732 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.339143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.342481 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.344246 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.541634 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:00.552787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:00.554355 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:00.556190 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4b45ebc4-8f46-4987-8821-f8d0a31fdd30 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.233763 May 16 15:16:00.556755 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 71/133] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:16:00 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:16:00.596279 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6af0ecdc-fcaf-438a-bb0b-e62005273613 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:00.599045 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6af0ecdc-fcaf-438a-bb0b-e62005273613 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:00.603782 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6af0ecdc-fcaf-438a-bb0b-e62005273613 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.604519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6af0ecdc-fcaf-438a-bb0b-e62005273613 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.605440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6af0ecdc-fcaf-438a-bb0b-e62005273613 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.605989 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6af0ecdc-fcaf-438a-bb0b-e62005273613 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.664225 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-a82d7d26-b252-4d7b-8172-4005da301636 req-2401bbb5-3510-4842-938c-7a7297f903fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893feede-4052-4c51-96a2-1f93510d1f5f", "name": "network-vif-plugged", "status": "completed", "tag": "7be8453f-3109-4b92-981a-837b09373d42"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:00.678093 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-a82d7d26-b252-4d7b-8172-4005da301636 req-2401bbb5-3510-4842-938c-7a7297f903fb service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.685836 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-a82d7d26-b252-4d7b-8172-4005da301636 req-2401bbb5-3510-4842-938c-7a7297f903fb service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.701582 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-a82d7d26-b252-4d7b-8172-4005da301636 req-2401bbb5-3510-4842-938c-7a7297f903fb service nova] Creating event network-vif-plugged:7be8453f-3109-4b92-981a-837b09373d42 for instance 893feede-4052-4c51-96a2-1f93510d1f5f on hv-cinder-84175 May 16 15:16:00.711814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-a82d7d26-b252-4d7b-8172-4005da301636 req-2401bbb5-3510-4842-938c-7a7297f903fb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047656 May 16 15:16:00.711814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 72/134] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:00.765140 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6af0ecdc-fcaf-438a-bb0b-e62005273613 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:00.773591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6af0ecdc-fcaf-438a-bb0b-e62005273613 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.181648 May 16 15:16:00.774270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 63/135] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:00 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:01.575140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:01.576941 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:01.584326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.584770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.591737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.591737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.746132 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:01.754718 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:01.756231 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:01.757669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1022373a-4f8f-4e73-9d61-749cace7d10e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.187135 May 16 15:16:01.758474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 73/136] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:16:01 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:16:01.791530 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d610bb11-f6c0-45b5-b38f-36a2381e7b93 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:01.792347 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d610bb11-f6c0-45b5-b38f-36a2381e7b93 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:01.799226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d610bb11-f6c0-45b5-b38f-36a2381e7b93 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.799924 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d610bb11-f6c0-45b5-b38f-36a2381e7b93 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.801211 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d610bb11-f6c0-45b5-b38f-36a2381e7b93 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.801759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d610bb11-f6c0-45b5-b38f-36a2381e7b93 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.966308 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-44c27f99-dce3-4691-8ab6-cdab319c62af req-155da240-080c-4e15-888d-c016e9354393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b1e4cf-ff7e-43d2-9351-ca6206651db4", "tag": "9d2d9f44-9262-4053-b198-1c13754b68fd"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:01.982654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-44c27f99-dce3-4691-8ab6-cdab319c62af req-155da240-080c-4e15-888d-c016e9354393 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.983237 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-44c27f99-dce3-4691-8ab6-cdab319c62af req-155da240-080c-4e15-888d-c016e9354393 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.995723 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-44c27f99-dce3-4691-8ab6-cdab319c62af req-155da240-080c-4e15-888d-c016e9354393 service nova] Creating event network-changed:9d2d9f44-9262-4053-b198-1c13754b68fd for instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 on hv-cinder-84175 May 16 15:16:02.003304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d610bb11-f6c0-45b5-b38f-36a2381e7b93 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:02.009260 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d610bb11-f6c0-45b5-b38f-36a2381e7b93 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.221483 May 16 15:16:02.010421 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 64/137] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:01 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:02.013323 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-44c27f99-dce3-4691-8ab6-cdab319c62af req-155da240-080c-4e15-888d-c016e9354393 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050621 May 16 15:16:02.014030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 74/138] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:16:02.776314 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:02.776846 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:02.783350 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:02.783832 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:02.785564 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:02.786075 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:02.999009 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:03.007738 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:03.011471 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:03.012661 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a72e1069-c6eb-44fd-b3a3-cbe7759ead91 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1406 microversion: 2.20 time: 0.240804 May 16 15:16:03.013221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 65/139] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:16:02 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:16:03.029546 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-03181a99-1e07-4c3b-a66c-943b65cfa5ee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:03.030440 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-03181a99-1e07-4c3b-a66c-943b65cfa5ee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:03.040256 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-03181a99-1e07-4c3b-a66c-943b65cfa5ee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:03.044261 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-03181a99-1e07-4c3b-a66c-943b65cfa5ee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:03.044261 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-03181a99-1e07-4c3b-a66c-943b65cfa5ee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:03.044552 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-03181a99-1e07-4c3b-a66c-943b65cfa5ee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:03.383210 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-03181a99-1e07-4c3b-a66c-943b65cfa5ee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:03.394969 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-03181a99-1e07-4c3b-a66c-943b65cfa5ee tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.369854 May 16 15:16:03.406572 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 75/140] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:03 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:04.030436 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:04.031056 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:04.043190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.044926 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.045467 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.045931 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.261278 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:04.275573 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:04.278838 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:04.280049 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c3fd17e7-de29-48ca-90c8-cdb47f356aec tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1598 microversion: 2.20 time: 0.253446 May 16 15:16:04.283003 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 66/141] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:16:04 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1598 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:16:04.300603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b2a4d971-9283-4c32-bbd1-1cf33aed714c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:04.300603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b2a4d971-9283-4c32-bbd1-1cf33aed714c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:04.306579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2a4d971-9283-4c32-bbd1-1cf33aed714c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.307030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2a4d971-9283-4c32-bbd1-1cf33aed714c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.307959 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2a4d971-9283-4c32-bbd1-1cf33aed714c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.308558 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2a4d971-9283-4c32-bbd1-1cf33aed714c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.390953 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b2a4d971-9283-4c32-bbd1-1cf33aed714c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095732 May 16 15:16:04.391549 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 76/142] 10.222.0.71 () {60 vars in 1315 bytes} [Mon May 16 15:16:04 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:16:04.414722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-801ad25e-04f8-4748-8bdf-f3c85b9c3c4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:04.415335 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-801ad25e-04f8-4748-8bdf-f3c85b9c3c4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:04.421629 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-801ad25e-04f8-4748-8bdf-f3c85b9c3c4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.422074 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-801ad25e-04f8-4748-8bdf-f3c85b9c3c4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.422844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-801ad25e-04f8-4748-8bdf-f3c85b9c3c4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.423272 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-801ad25e-04f8-4748-8bdf-f3c85b9c3c4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.748782 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-801ad25e-04f8-4748-8bdf-f3c85b9c3c4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:04.759291 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-801ad25e-04f8-4748-8bdf-f3c85b9c3c4c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.348684 May 16 15:16:04.760321 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 67/143] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:04 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:05.784635 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1fdffa20-1c52-4442-95a0-6b7e5b6b1229 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:05.785653 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1fdffa20-1c52-4442-95a0-6b7e5b6b1229 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:05.791960 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1fdffa20-1c52-4442-95a0-6b7e5b6b1229 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:05.792518 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1fdffa20-1c52-4442-95a0-6b7e5b6b1229 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:05.793576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1fdffa20-1c52-4442-95a0-6b7e5b6b1229 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:05.794085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1fdffa20-1c52-4442-95a0-6b7e5b6b1229 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:06.017697 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1fdffa20-1c52-4442-95a0-6b7e5b6b1229 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:06.025823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1fdffa20-1c52-4442-95a0-6b7e5b6b1229 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.248945 May 16 15:16:06.026402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 77/144] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:05 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:06.122939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-8c5bb977-4f8c-48cb-bd20-4a16594ecb70 req-de3572bd-128f-4a98-b6a1-7f5c4ee1f8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893feede-4052-4c51-96a2-1f93510d1f5f", "tag": "7be8453f-3109-4b92-981a-837b09373d42"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:06.135475 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-8c5bb977-4f8c-48cb-bd20-4a16594ecb70 req-de3572bd-128f-4a98-b6a1-7f5c4ee1f8c3 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:06.136179 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-8c5bb977-4f8c-48cb-bd20-4a16594ecb70 req-de3572bd-128f-4a98-b6a1-7f5c4ee1f8c3 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:06.152905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-8c5bb977-4f8c-48cb-bd20-4a16594ecb70 req-de3572bd-128f-4a98-b6a1-7f5c4ee1f8c3 service nova] Creating event network-changed:7be8453f-3109-4b92-981a-837b09373d42 for instance 893feede-4052-4c51-96a2-1f93510d1f5f on hv-cinder-84175 May 16 15:16:06.161754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-8c5bb977-4f8c-48cb-bd20-4a16594ecb70 req-de3572bd-128f-4a98-b6a1-7f5c4ee1f8c3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052225 May 16 15:16:06.163183 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 68/145] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:07.044732 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-36d4aa19-bc8a-4e93-8a6c-2c2e9b8fbc3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:07.046135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-36d4aa19-bc8a-4e93-8a6c-2c2e9b8fbc3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:07.055290 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-36d4aa19-bc8a-4e93-8a6c-2c2e9b8fbc3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:07.055931 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-36d4aa19-bc8a-4e93-8a6c-2c2e9b8fbc3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:07.057325 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-36d4aa19-bc8a-4e93-8a6c-2c2e9b8fbc3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:07.058405 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-36d4aa19-bc8a-4e93-8a6c-2c2e9b8fbc3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:07.212676 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-36d4aa19-bc8a-4e93-8a6c-2c2e9b8fbc3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:07.220340 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-36d4aa19-bc8a-4e93-8a6c-2c2e9b8fbc3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.181318 May 16 15:16:07.220920 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 78/146] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:07 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:08.239240 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-297d6460-9a3e-4fe5-9458-8e17f90a768f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:08.239993 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-297d6460-9a3e-4fe5-9458-8e17f90a768f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:08.246518 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-297d6460-9a3e-4fe5-9458-8e17f90a768f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.253981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-297d6460-9a3e-4fe5-9458-8e17f90a768f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.253981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-297d6460-9a3e-4fe5-9458-8e17f90a768f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.253981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-297d6460-9a3e-4fe5-9458-8e17f90a768f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.534948 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-297d6460-9a3e-4fe5-9458-8e17f90a768f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:08.542624 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-297d6460-9a3e-4fe5-9458-8e17f90a768f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.308657 May 16 15:16:08.543190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 69/147] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:08 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:08.847709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-07cdb4d1-da04-4fbf-a79a-3f955e04ed06 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:08.848446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-07cdb4d1-da04-4fbf-a79a-3f955e04ed06 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:08.860516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-07cdb4d1-da04-4fbf-a79a-3f955e04ed06 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.863259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-07cdb4d1-da04-4fbf-a79a-3f955e04ed06 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.867986 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-07cdb4d1-da04-4fbf-a79a-3f955e04ed06 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.868879 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-07cdb4d1-da04-4fbf-a79a-3f955e04ed06 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.915797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-07cdb4d1-da04-4fbf-a79a-3f955e04ed06 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:16:09.249225 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-07cdb4d1-da04-4fbf-a79a-3f955e04ed06 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 204 len: 0 microversion: 2.1 time: 0.406444 May 16 15:16:09.252965 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 79/148] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:16:08 2022] DELETE /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:16:09.258031 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ccec1c22-71d1-4a16-9b9b-c1dfd9b93f25 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:09.260670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ccec1c22-71d1-4a16-9b9b-c1dfd9b93f25 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:09.267037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ccec1c22-71d1-4a16-9b9b-c1dfd9b93f25 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:09.267568 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ccec1c22-71d1-4a16-9b9b-c1dfd9b93f25 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:09.269060 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ccec1c22-71d1-4a16-9b9b-c1dfd9b93f25 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:09.273754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ccec1c22-71d1-4a16-9b9b-c1dfd9b93f25 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:09.427271 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ccec1c22-71d1-4a16-9b9b-c1dfd9b93f25 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:09.436092 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ccec1c22-71d1-4a16-9b9b-c1dfd9b93f25 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1553 microversion: 2.1 time: 0.181852 May 16 15:16:09.436680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 70/149] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:09 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:09.560772 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d87302d1-f00d-4b16-8aaf-336a8e7dac72 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:09.561464 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d87302d1-f00d-4b16-8aaf-336a8e7dac72 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:09.568422 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d87302d1-f00d-4b16-8aaf-336a8e7dac72 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:09.568871 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d87302d1-f00d-4b16-8aaf-336a8e7dac72 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:09.569641 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d87302d1-f00d-4b16-8aaf-336a8e7dac72 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:09.570093 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d87302d1-f00d-4b16-8aaf-336a8e7dac72 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:09.713454 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d87302d1-f00d-4b16-8aaf-336a8e7dac72 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:09.721232 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d87302d1-f00d-4b16-8aaf-336a8e7dac72 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.164558 May 16 15:16:09.721839 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 80/150] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:09 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:10.454352 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c56e55ac-a465-4ff6-a1b6-a0f2735b797a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:10.454961 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c56e55ac-a465-4ff6-a1b6-a0f2735b797a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:10.462178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c56e55ac-a465-4ff6-a1b6-a0f2735b797a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:10.462571 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c56e55ac-a465-4ff6-a1b6-a0f2735b797a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:10.463334 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c56e55ac-a465-4ff6-a1b6-a0f2735b797a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:10.463788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c56e55ac-a465-4ff6-a1b6-a0f2735b797a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:10.739070 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c0fc0a70-7b45-4561-9b89-34acd0fc9531 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:10.739721 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c0fc0a70-7b45-4561-9b89-34acd0fc9531 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:10.751317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c0fc0a70-7b45-4561-9b89-34acd0fc9531 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:10.751317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c0fc0a70-7b45-4561-9b89-34acd0fc9531 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:10.751317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c0fc0a70-7b45-4561-9b89-34acd0fc9531 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:10.751317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c0fc0a70-7b45-4561-9b89-34acd0fc9531 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:10.857124 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c56e55ac-a465-4ff6-a1b6-a0f2735b797a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:10.865646 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c56e55ac-a465-4ff6-a1b6-a0f2735b797a tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1553 microversion: 2.1 time: 0.415123 May 16 15:16:10.866209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 71/151] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:10 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1553 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:10.902020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c0fc0a70-7b45-4561-9b89-34acd0fc9531 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:10.910389 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c0fc0a70-7b45-4561-9b89-34acd0fc9531 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.175778 May 16 15:16:10.910954 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 81/152] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:10 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:11.882091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f073ffba-899e-49a6-8da4-263fee2ca156 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:11.882703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f073ffba-899e-49a6-8da4-263fee2ca156 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:11.888898 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f073ffba-899e-49a6-8da4-263fee2ca156 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:11.889338 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f073ffba-899e-49a6-8da4-263fee2ca156 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:11.892007 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f073ffba-899e-49a6-8da4-263fee2ca156 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:11.892007 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f073ffba-899e-49a6-8da4-263fee2ca156 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:11.928194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-758697c9-366e-484a-892c-11459553df61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:11.929590 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-758697c9-366e-484a-892c-11459553df61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:11.935928 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-758697c9-366e-484a-892c-11459553df61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:11.936460 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-758697c9-366e-484a-892c-11459553df61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:11.937290 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-758697c9-366e-484a-892c-11459553df61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:11.938064 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-758697c9-366e-484a-892c-11459553df61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:12.080625 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f073ffba-899e-49a6-8da4-263fee2ca156 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:12.110441 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f073ffba-899e-49a6-8da4-263fee2ca156 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1553 microversion: 2.1 time: 0.231844 May 16 15:16:12.121022 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 72/153] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:11 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:12.127501 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-758697c9-366e-484a-892c-11459553df61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:12.136854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-758697c9-366e-484a-892c-11459553df61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.213175 May 16 15:16:12.147727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 82/154] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:11 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:13.126839 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-653d66ab-185f-418d-b110-db1e4354f27e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:13.127446 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-653d66ab-185f-418d-b110-db1e4354f27e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:13.134242 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-653d66ab-185f-418d-b110-db1e4354f27e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:13.134722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-653d66ab-185f-418d-b110-db1e4354f27e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:13.137754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-653d66ab-185f-418d-b110-db1e4354f27e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:13.137754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-653d66ab-185f-418d-b110-db1e4354f27e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:13.154330 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5d34dc3e-7ef4-4809-8758-2a7bba07689e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:13.155514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5d34dc3e-7ef4-4809-8758-2a7bba07689e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:13.162955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5d34dc3e-7ef4-4809-8758-2a7bba07689e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:13.163402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5d34dc3e-7ef4-4809-8758-2a7bba07689e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:13.164189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5d34dc3e-7ef4-4809-8758-2a7bba07689e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:13.164645 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5d34dc3e-7ef4-4809-8758-2a7bba07689e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:13.456847 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-653d66ab-185f-418d-b110-db1e4354f27e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:13.461555 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5d34dc3e-7ef4-4809-8758-2a7bba07689e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:13.470710 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-653d66ab-185f-418d-b110-db1e4354f27e tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1553 microversion: 2.1 time: 0.347721 May 16 15:16:13.471286 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 73/155] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:13 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1553 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:13.480375 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-aa9ef5ed-57dd-41ad-9587-4ae57b80a3ef req-01d986b8-736c-4515-afee-f6d395e16f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c247c0bb-0802-47bf-8790-6d17eb129c28", "name": "network-vif-deleted", "tag": "01d8431d-7010-47b2-8c50-59586072403b"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:13.483823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5d34dc3e-7ef4-4809-8758-2a7bba07689e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.325453 May 16 15:16:13.484522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 83/156] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:13 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:13.489462 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-aa9ef5ed-57dd-41ad-9587-4ae57b80a3ef req-01d986b8-736c-4515-afee-f6d395e16f94 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:13.489938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-aa9ef5ed-57dd-41ad-9587-4ae57b80a3ef req-01d986b8-736c-4515-afee-f6d395e16f94 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:13.500652 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-aa9ef5ed-57dd-41ad-9587-4ae57b80a3ef req-01d986b8-736c-4515-afee-f6d395e16f94 service nova] Creating event network-vif-deleted:01d8431d-7010-47b2-8c50-59586072403b for instance c247c0bb-0802-47bf-8790-6d17eb129c28 on hv-cinder-84175 May 16 15:16:13.506447 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-aa9ef5ed-57dd-41ad-9587-4ae57b80a3ef req-01d986b8-736c-4515-afee-f6d395e16f94 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029591 May 16 15:16:13.507029 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 74/157] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:14.488968 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:14.489582 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:14.495579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:14.496057 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:14.496832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:14.497263 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:14.502045 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-63f63ee6-98eb-4fb4-8919-8423bf46a709 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:14.503376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-63f63ee6-98eb-4fb4-8919-8423bf46a709 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:14.509477 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63f63ee6-98eb-4fb4-8919-8423bf46a709 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:14.509920 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63f63ee6-98eb-4fb4-8919-8423bf46a709 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:14.510680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63f63ee6-98eb-4fb4-8919-8423bf46a709 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:14.511115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63f63ee6-98eb-4fb4-8919-8423bf46a709 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:14.530972 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:14.531418 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:14.531890 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lazy-loading 'fault' on Instance uuid c247c0bb-0802-47bf-8790-6d17eb129c28 {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:16:14.639450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dc7683c04d42ffa5642c97a2f25d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494afadf76c94f859b141309a6a3e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:14.639450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-187b1cf4-211f-4922-9de0-23bc9c6128ac tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 200 len: 1351 microversion: 2.1 time: 0.154269 May 16 15:16:14.639450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 84/158] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:14 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 1351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:14.705694 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-63f63ee6-98eb-4fb4-8919-8423bf46a709 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:14.713858 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-63f63ee6-98eb-4fb4-8919-8423bf46a709 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.216400 May 16 15:16:14.714713 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 75/159] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:14 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:15.656310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:15.657014 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:15.665194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:15.666449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:15.666449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:15.666904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:15.682659 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] HTTP exception thrown: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Request method failure captured: May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 HTTP/1.1 May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqAAyC0zZiLS-onuaXScmegywFpS9nSzpqtrI2NY5ijLwl-47LgbBq8gT7Mi5Sk7WvE_TqlEHCgfmjtqSKyFdkDz16GBrd58X_dPSIbCOb86_3MzL46Z_YZuCufPZ6bw7-4ehU2B161jTD_a-d0tYkOOLSqoWDP2ZS-0AZtrC7yjbE May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 494afadf76c94f859b141309a6a3e37b May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:16:15.700363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/494afadf76c94f859b141309a6a3e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/494afadf76c94f859b141309a6a3e37b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_494afadf76c94f859b141309a6a3e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/494afadf76c94f859b141309a6a3e37b"}]}] May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 494afadf76c94f859b141309a6a3e37b May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-DeleteServersTestJSON-1675500696-project May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: f3dc7683c04d42ffa5642c97a2f25d1d May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-DeleteServersTestJSON-1675500696-project May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.701564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'c247c0bb-0802-47bf-8790-6d17eb129c28'} May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:16:15.702305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.703449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.705280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Returning 404 to user: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:16:15.705280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ae145330-c262-4b3c-8f57-9a504f2f0e05 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 404 len: 111 microversion: 2.1 time: 0.049870 May 16 15:16:15.707735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 85/160] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:15 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:16:15.733846 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-65f73e3b-e5c1-47e0-b02f-9bbb5dbfc532 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:15.742510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-65f73e3b-e5c1-47e0-b02f-9bbb5dbfc532 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:15.742510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65f73e3b-e5c1-47e0-b02f-9bbb5dbfc532 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:15.743462 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65f73e3b-e5c1-47e0-b02f-9bbb5dbfc532 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:15.744520 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65f73e3b-e5c1-47e0-b02f-9bbb5dbfc532 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:15.745346 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65f73e3b-e5c1-47e0-b02f-9bbb5dbfc532 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:15.843550 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:15.844574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:15.851687 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:15.852669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:15.853497 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:15.853998 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:15.870802 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] HTTP exception thrown: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Request method failure captured: May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28/os-volume_attachments HTTP/1.1 May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqAAyC0zZiLS-onuaXScmegywFpS9nSzpqtrI2NY5ijLwl-47LgbBq8gT7Mi5Sk7WvE_TqlEHCgfmjtqSKyFdkDz16GBrd58X_dPSIbCOb86_3MzL46Z_YZuCufPZ6bw7-4ehU2B161jTD_a-d0tYkOOLSqoWDP2ZS-0AZtrC7yjbE May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 494afadf76c94f859b141309a6a3e37b May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:16:15.872830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/494afadf76c94f859b141309a6a3e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/494afadf76c94f859b141309a6a3e37b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_494afadf76c94f859b141309a6a3e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/494afadf76c94f859b141309a6a3e37b"}]}] May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 494afadf76c94f859b141309a6a3e37b May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-DeleteServersTestJSON-1675500696-project May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: f3dc7683c04d42ffa5642c97a2f25d1d May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-DeleteServersTestJSON-1675500696-project May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.873946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'server_id': 'c247c0bb-0802-47bf-8790-6d17eb129c28'} May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:16:15.874576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:15.875576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:15.881282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Returning 404 to user: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:16:15.881282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-20cc7578-f39d-459e-a1ea-163749f0c217 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039238 May 16 15:16:15.881282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 86/161] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:16:15 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:16:16.015204 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-65f73e3b-e5c1-47e0-b02f-9bbb5dbfc532 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:16.016210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-65f73e3b-e5c1-47e0-b02f-9bbb5dbfc532 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.287275 May 16 15:16:16.016775 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 76/162] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:15 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:17.034084 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-57a5e426-ca12-4bc5-8ff7-b4340da4485b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:17.034807 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-57a5e426-ca12-4bc5-8ff7-b4340da4485b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:17.040657 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-57a5e426-ca12-4bc5-8ff7-b4340da4485b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:17.041115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-57a5e426-ca12-4bc5-8ff7-b4340da4485b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:17.041878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-57a5e426-ca12-4bc5-8ff7-b4340da4485b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:17.042322 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-57a5e426-ca12-4bc5-8ff7-b4340da4485b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:17.171027 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-57a5e426-ca12-4bc5-8ff7-b4340da4485b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:17.184008 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-57a5e426-ca12-4bc5-8ff7-b4340da4485b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.153666 May 16 15:16:17.194682 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 87/163] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:17 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:17.306526 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:17.307004 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:17.313321 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:17.313768 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:17.314528 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:17.314954 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:17.328486 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] HTTP exception thrown: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Request method failure captured: May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: DELETE /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 HTTP/1.1 May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqAAyC0zZiLS-onuaXScmegywFpS9nSzpqtrI2NY5ijLwl-47LgbBq8gT7Mi5Sk7WvE_TqlEHCgfmjtqSKyFdkDz16GBrd58X_dPSIbCOb86_3MzL46Z_YZuCufPZ6bw7-4ehU2B161jTD_a-d0tYkOOLSqoWDP2ZS-0AZtrC7yjbE May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 494afadf76c94f859b141309a6a3e37b May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:16:17.333304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/494afadf76c94f859b141309a6a3e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/494afadf76c94f859b141309a6a3e37b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_494afadf76c94f859b141309a6a3e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/494afadf76c94f859b141309a6a3e37b"}]}] May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 494afadf76c94f859b141309a6a3e37b May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-DeleteServersTestJSON-1675500696-project May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: f3dc7683c04d42ffa5642c97a2f25d1d May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-DeleteServersTestJSON-1675500696-project May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.334706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': 'c247c0bb-0802-47bf-8790-6d17eb129c28'} May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:16:17.335556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.336788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:16:17.338182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Returning 404 to user: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:16:17.338182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4a6b3577-7223-4546-9de4-3a73f461b784 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 404 len: 111 microversion: 2.1 time: 0.031933 May 16 15:16:17.338182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 77/164] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:16:17 2022] DELETE /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:16:17.343909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:17.344523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] [instance: c247c0bb-0802-47bf-8790-6d17eb129c28] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:17.350673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:17.351124 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:17.351916 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:17.352350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:17.366056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] HTTP exception thrown: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Request method failure captured: May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 HTTP/1.1 May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqAAyC0zZiLS-onuaXScmegywFpS9nSzpqtrI2NY5ijLwl-47LgbBq8gT7Mi5Sk7WvE_TqlEHCgfmjtqSKyFdkDz16GBrd58X_dPSIbCOb86_3MzL46Z_YZuCufPZ6bw7-4ehU2B161jTD_a-d0tYkOOLSqoWDP2ZS-0AZtrC7yjbE May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 494afadf76c94f859b141309a6a3e37b May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:16:17.367560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/494afadf76c94f859b141309a6a3e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/494afadf76c94f859b141309a6a3e37b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_494afadf76c94f859b141309a6a3e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/494afadf76c94f859b141309a6a3e37b"}]}] May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 494afadf76c94f859b141309a6a3e37b May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675500696 May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-DeleteServersTestJSON-1675500696-project May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: f3dc7683c04d42ffa5642c97a2f25d1d May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-DeleteServersTestJSON-1675500696-project May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.369025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'c247c0bb-0802-47bf-8790-6d17eb129c28'} May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:16:17.369891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. May 16 15:16:17.376859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:16:17.379038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] Returning 404 to user: Instance c247c0bb-0802-47bf-8790-6d17eb129c28 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:16:17.379038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c14f511b-e992-49ce-b5a0-18f69f5751e5 tempest-DeleteServersTestJSON-1675500696 tempest-DeleteServersTestJSON-1675500696-project] 10.222.0.71 "GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28" status: 404 len: 111 microversion: 2.1 time: 0.028828 May 16 15:16:17.379038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 88/165] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:17 2022] GET /compute/v2.1/servers/c247c0bb-0802-47bf-8790-6d17eb129c28 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:16:18.201769 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-16982536-7f76-471e-964c-23a5df2f389c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:18.202476 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-16982536-7f76-471e-964c-23a5df2f389c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:18.208784 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-16982536-7f76-471e-964c-23a5df2f389c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:18.209226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-16982536-7f76-471e-964c-23a5df2f389c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:18.209990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-16982536-7f76-471e-964c-23a5df2f389c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:18.210413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-16982536-7f76-471e-964c-23a5df2f389c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:18.370553 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-16982536-7f76-471e-964c-23a5df2f389c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:18.378053 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-16982536-7f76-471e-964c-23a5df2f389c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.180100 May 16 15:16:18.378916 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 78/166] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:18 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:19.403225 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-585e54da-5d12-453b-8474-f6aa3d527f0f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:19.404393 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-585e54da-5d12-453b-8474-f6aa3d527f0f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:19.413758 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-585e54da-5d12-453b-8474-f6aa3d527f0f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:19.414073 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-585e54da-5d12-453b-8474-f6aa3d527f0f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:19.416203 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-585e54da-5d12-453b-8474-f6aa3d527f0f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:19.417010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-585e54da-5d12-453b-8474-f6aa3d527f0f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:19.557628 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-585e54da-5d12-453b-8474-f6aa3d527f0f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:19.568874 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-585e54da-5d12-453b-8474-f6aa3d527f0f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.175276 May 16 15:16:19.569442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 89/167] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:19 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:20.588678 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9a7d0c1d-4b3b-406e-ad12-20bf00f8b6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:20.590706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9a7d0c1d-4b3b-406e-ad12-20bf00f8b6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:20.600958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c1d-4b3b-406e-ad12-20bf00f8b6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:20.603132 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c1d-4b3b-406e-ad12-20bf00f8b6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:20.603947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c1d-4b3b-406e-ad12-20bf00f8b6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:20.604651 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c1d-4b3b-406e-ad12-20bf00f8b6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:20.762208 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9a7d0c1d-4b3b-406e-ad12-20bf00f8b6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:20.773868 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9a7d0c1d-4b3b-406e-ad12-20bf00f8b6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.190546 May 16 15:16:20.774610 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 79/168] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:20 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:21.790945 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1c452d5a-280a-4fb5-b129-e44ab1a6e2a5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:21.791651 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1c452d5a-280a-4fb5-b129-e44ab1a6e2a5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:21.797767 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1c452d5a-280a-4fb5-b129-e44ab1a6e2a5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:21.798219 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1c452d5a-280a-4fb5-b129-e44ab1a6e2a5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:21.798997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1c452d5a-280a-4fb5-b129-e44ab1a6e2a5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:21.799590 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1c452d5a-280a-4fb5-b129-e44ab1a6e2a5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:21.937655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1c452d5a-280a-4fb5-b129-e44ab1a6e2a5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:21.946161 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1c452d5a-280a-4fb5-b129-e44ab1a6e2a5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.159045 May 16 15:16:21.946772 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 90/169] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:21 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:22.964182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b54c652f-ef19-494d-bcca-49439caa2850 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:22.964822 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b54c652f-ef19-494d-bcca-49439caa2850 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:22.971148 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b54c652f-ef19-494d-bcca-49439caa2850 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:22.973536 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b54c652f-ef19-494d-bcca-49439caa2850 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:22.974564 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b54c652f-ef19-494d-bcca-49439caa2850 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:22.975073 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b54c652f-ef19-494d-bcca-49439caa2850 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:23.151179 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b54c652f-ef19-494d-bcca-49439caa2850 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:23.159818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b54c652f-ef19-494d-bcca-49439caa2850 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.199585 May 16 15:16:23.160588 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 80/170] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:22 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:24.180685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7b9aa8b8-a2fd-4c30-9fd9-b43b4a6fcf34 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:24.180685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7b9aa8b8-a2fd-4c30-9fd9-b43b4a6fcf34 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:24.185747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b9aa8b8-a2fd-4c30-9fd9-b43b4a6fcf34 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:24.186351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b9aa8b8-a2fd-4c30-9fd9-b43b4a6fcf34 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:24.187073 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b9aa8b8-a2fd-4c30-9fd9-b43b4a6fcf34 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:24.187435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b9aa8b8-a2fd-4c30-9fd9-b43b4a6fcf34 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:24.417310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7b9aa8b8-a2fd-4c30-9fd9-b43b4a6fcf34 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:24.428839 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7b9aa8b8-a2fd-4c30-9fd9-b43b4a6fcf34 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.256410 May 16 15:16:24.429509 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 91/171] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:24 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:25.447587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d4c1c54d-0d29-4866-845c-6c43aee461c7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:25.450030 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d4c1c54d-0d29-4866-845c-6c43aee461c7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:25.456456 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4c1c54d-0d29-4866-845c-6c43aee461c7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:25.456913 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4c1c54d-0d29-4866-845c-6c43aee461c7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:25.457691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4c1c54d-0d29-4866-845c-6c43aee461c7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:25.458124 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4c1c54d-0d29-4866-845c-6c43aee461c7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:25.668998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d4c1c54d-0d29-4866-845c-6c43aee461c7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:25.678396 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d4c1c54d-0d29-4866-845c-6c43aee461c7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.234924 May 16 15:16:25.679119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 81/172] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:25 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:26.695129 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fbba5836-c245-47b4-8de5-136ef1c16936 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:26.695774 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fbba5836-c245-47b4-8de5-136ef1c16936 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:26.708557 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fbba5836-c245-47b4-8de5-136ef1c16936 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:26.709018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fbba5836-c245-47b4-8de5-136ef1c16936 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:26.709935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fbba5836-c245-47b4-8de5-136ef1c16936 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:26.710375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fbba5836-c245-47b4-8de5-136ef1c16936 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:27.028777 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-fbba5836-c245-47b4-8de5-136ef1c16936 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:27.044539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-fbba5836-c245-47b4-8de5-136ef1c16936 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.353301 May 16 15:16:27.048859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 92/173] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:26 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:27.626204 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c7efa58d-62a6-40d3-af8f-7a29fabf9391 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'create', calling method: .version_select at 0x7f0c881563a0>, body: {"keypair": {"name": "tempest-keypair-1425357386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApIbhTWH40lPRvPdlRYOXiJYuHfFDn0c5Cm+QSl2xk6AYNc5rSy3R2AuqOYdTuNBqw3k/soIeZhxjZVDJPmVuDPhc2rWg2bU+RXfstMBdS6u7o46akx/MKFmZVjH26mjA=="}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:27.640073 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-c7efa58d-62a6-40d3-af8f-7a29fabf9391 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Getting quotas for project 9886c48c5650408cacaa4e7f78586404. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:16:27.644428 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-c7efa58d-62a6-40d3-af8f-7a29fabf9391 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Getting quotas for user 426aa73007cd4ca3b8c165b87f69c02e and project 9886c48c5650408cacaa4e7f78586404. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:16:27.736582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c7efa58d-62a6-40d3-af8f-7a29fabf9391 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.347956 May 16 15:16:27.744574 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 82/174] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:16:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:28.072317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b2d4e302-92ed-4435-a42e-7c7a7db6269e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:28.087605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b2d4e302-92ed-4435-a42e-7c7a7db6269e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:28.087605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2d4e302-92ed-4435-a42e-7c7a7db6269e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:28.087605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2d4e302-92ed-4435-a42e-7c7a7db6269e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:28.087605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2d4e302-92ed-4435-a42e-7c7a7db6269e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:28.088343 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2d4e302-92ed-4435-a42e-7c7a7db6269e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:28.302721 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b2d4e302-92ed-4435-a42e-7c7a7db6269e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:28.310488 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b2d4e302-92ed-4435-a42e-7c7a7db6269e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.242388 May 16 15:16:28.311426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 93/175] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:28 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:29.328390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-69ffe0d7-eb70-4d66-88c4-7919327e91ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:29.329148 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-69ffe0d7-eb70-4d66-88c4-7919327e91ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:29.345639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-69ffe0d7-eb70-4d66-88c4-7919327e91ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:29.347464 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-69ffe0d7-eb70-4d66-88c4-7919327e91ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:29.348598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-69ffe0d7-eb70-4d66-88c4-7919327e91ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:29.349026 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-69ffe0d7-eb70-4d66-88c4-7919327e91ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:29.554743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-69ffe0d7-eb70-4d66-88c4-7919327e91ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:29.564373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-69ffe0d7-eb70-4d66-88c4-7919327e91ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.239766 May 16 15:16:29.565376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 83/176] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:29 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:30.526520 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1133548161", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5d840d6-be4b-4ccc-949a-d641977c970e"}], "security_groups": [{"name": "tempest-securitygroup--1596331720"}], "key_name": "tempest-keypair-1425357386", "user_data": "}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:30.593691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d29b9eaa-1b86-473d-bb9d-820fc5e80c19 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:30.593691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d29b9eaa-1b86-473d-bb9d-820fc5e80c19 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:30.593691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d29b9eaa-1b86-473d-bb9d-820fc5e80c19 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:30.593691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d29b9eaa-1b86-473d-bb9d-820fc5e80c19 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:30.595085 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d29b9eaa-1b86-473d-bb9d-820fc5e80c19 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:30.595085 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d29b9eaa-1b86-473d-bb9d-820fc5e80c19 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:30.653538 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] validate_networks() for [('d5d840d6-be4b-4ccc-949a-d641977c970e', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:16:30.817742 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d29b9eaa-1b86-473d-bb9d-820fc5e80c19 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:30.825962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d29b9eaa-1b86-473d-bb9d-820fc5e80c19 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.245507 May 16 15:16:30.826548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 84/177] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:30 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:31.090540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:16:31.090958 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:16:31.091428 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:16:31.091870 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:16:31.092281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:16:31.101412 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.101847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.102689 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.103128 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.121492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Getting quotas for project 9886c48c5650408cacaa4e7f78586404. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:16:31.125424 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Getting quotas for user 426aa73007cd4ca3b8c165b87f69c02e and project 9886c48c5650408cacaa4e7f78586404. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:16:31.137244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:16:31.139515 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:16:31.255652 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f10eb347-641f-44e9-9b00-45aac0d7a643 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.733740 May 16 15:16:31.256234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 94/178] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:16:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:16:31.266220 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7684d871-d377-4bd6-bdd1-fbe45b721e07 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:31.266897 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7684d871-d377-4bd6-bdd1-fbe45b721e07 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:31.327852 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7684d871-d377-4bd6-bdd1-fbe45b721e07 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:31.335552 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7684d871-d377-4bd6-bdd1-fbe45b721e07 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1238 microversion: 2.1 time: 0.073085 May 16 15:16:31.336159 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 85/179] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:31 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:31.853238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d25a4b76-5490-4583-a56d-8848a2f0bc91 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:31.853238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d25a4b76-5490-4583-a56d-8848a2f0bc91 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:31.853238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d25a4b76-5490-4583-a56d-8848a2f0bc91 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.853238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d25a4b76-5490-4583-a56d-8848a2f0bc91 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.854438 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d25a4b76-5490-4583-a56d-8848a2f0bc91 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.854438 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d25a4b76-5490-4583-a56d-8848a2f0bc91 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.994470 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d25a4b76-5490-4583-a56d-8848a2f0bc91 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:32.002253 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d25a4b76-5490-4583-a56d-8848a2f0bc91 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.163569 May 16 15:16:32.003614 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 95/180] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:31 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:32.353212 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6d79286e-f5ce-4673-b063-7b21b905a7c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:32.353820 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6d79286e-f5ce-4673-b063-7b21b905a7c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:32.360601 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d79286e-f5ce-4673-b063-7b21b905a7c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:32.361040 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d79286e-f5ce-4673-b063-7b21b905a7c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:32.361861 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d79286e-f5ce-4673-b063-7b21b905a7c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:32.362342 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d79286e-f5ce-4673-b063-7b21b905a7c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:32.428215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6d79286e-f5ce-4673-b063-7b21b905a7c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:32.435623 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6d79286e-f5ce-4673-b063-7b21b905a7c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1242 microversion: 2.1 time: 0.086258 May 16 15:16:32.436404 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 86/181] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:32 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:33.020810 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8f592dfb-0b38-4bd1-a262-b2f3e657ed82 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:33.021770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8f592dfb-0b38-4bd1-a262-b2f3e657ed82 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:33.027755 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8f592dfb-0b38-4bd1-a262-b2f3e657ed82 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.028173 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8f592dfb-0b38-4bd1-a262-b2f3e657ed82 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.028966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8f592dfb-0b38-4bd1-a262-b2f3e657ed82 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.029388 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8f592dfb-0b38-4bd1-a262-b2f3e657ed82 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.166217 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8f592dfb-0b38-4bd1-a262-b2f3e657ed82 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:33.167057 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8f592dfb-0b38-4bd1-a262-b2f3e657ed82 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.150812 May 16 15:16:33.167647 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 96/182] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:33 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:33.452430 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9bad467c-eadc-4bbf-9fd1-7388e42245d7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:33.453038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9bad467c-eadc-4bbf-9fd1-7388e42245d7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:33.459588 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9bad467c-eadc-4bbf-9fd1-7388e42245d7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.460061 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9bad467c-eadc-4bbf-9fd1-7388e42245d7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.460867 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9bad467c-eadc-4bbf-9fd1-7388e42245d7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.461326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9bad467c-eadc-4bbf-9fd1-7388e42245d7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.521214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9bad467c-eadc-4bbf-9fd1-7388e42245d7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:33.528725 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9bad467c-eadc-4bbf-9fd1-7388e42245d7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1242 microversion: 2.1 time: 0.080228 May 16 15:16:33.529286 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 87/183] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:33 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:34.184168 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e16df075-61e5-4d87-a97b-fbb3a9426b22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:34.185388 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e16df075-61e5-4d87-a97b-fbb3a9426b22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:34.192279 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e16df075-61e5-4d87-a97b-fbb3a9426b22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.192724 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e16df075-61e5-4d87-a97b-fbb3a9426b22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.197038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e16df075-61e5-4d87-a97b-fbb3a9426b22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.197038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e16df075-61e5-4d87-a97b-fbb3a9426b22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.324793 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e16df075-61e5-4d87-a97b-fbb3a9426b22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:34.332996 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e16df075-61e5-4d87-a97b-fbb3a9426b22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.152650 May 16 15:16:34.333583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 97/184] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:34 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:34.545962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5aaef206-409c-44ed-bd9f-e534a3ff7a36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:34.546508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5aaef206-409c-44ed-bd9f-e534a3ff7a36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:34.553233 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5aaef206-409c-44ed-bd9f-e534a3ff7a36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.553718 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5aaef206-409c-44ed-bd9f-e534a3ff7a36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.554525 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5aaef206-409c-44ed-bd9f-e534a3ff7a36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.554966 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5aaef206-409c-44ed-bd9f-e534a3ff7a36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.616476 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5aaef206-409c-44ed-bd9f-e534a3ff7a36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:34.624239 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5aaef206-409c-44ed-bd9f-e534a3ff7a36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1242 microversion: 2.1 time: 0.082120 May 16 15:16:34.625570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 88/185] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:34 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:35.351036 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-30eb40a3-4cd8-45ac-bdbc-107d0c8177f8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:35.351863 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-30eb40a3-4cd8-45ac-bdbc-107d0c8177f8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:35.357632 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-30eb40a3-4cd8-45ac-bdbc-107d0c8177f8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.358085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-30eb40a3-4cd8-45ac-bdbc-107d0c8177f8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.358844 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-30eb40a3-4cd8-45ac-bdbc-107d0c8177f8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.359280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-30eb40a3-4cd8-45ac-bdbc-107d0c8177f8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.488753 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-30eb40a3-4cd8-45ac-bdbc-107d0c8177f8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:35.501415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-30eb40a3-4cd8-45ac-bdbc-107d0c8177f8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.150324 May 16 15:16:35.501415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 98/186] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:35 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:35.641519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-023c6ea1-ea0d-453a-9419-3c3cc79fa6a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:35.642128 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-023c6ea1-ea0d-453a-9419-3c3cc79fa6a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:35.648727 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-023c6ea1-ea0d-453a-9419-3c3cc79fa6a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.649190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-023c6ea1-ea0d-453a-9419-3c3cc79fa6a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.649999 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-023c6ea1-ea0d-453a-9419-3c3cc79fa6a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.650413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-023c6ea1-ea0d-453a-9419-3c3cc79fa6a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.720815 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-023c6ea1-ea0d-453a-9419-3c3cc79fa6a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:35.727958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-023c6ea1-ea0d-453a-9419-3c3cc79fa6a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1234 microversion: 2.1 time: 0.090312 May 16 15:16:35.728338 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 89/187] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:35 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:36.516373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d62bd21c-7cd8-4e8b-86e2-896f174d7e61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:36.517001 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d62bd21c-7cd8-4e8b-86e2-896f174d7e61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:36.524196 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d62bd21c-7cd8-4e8b-86e2-896f174d7e61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.524653 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d62bd21c-7cd8-4e8b-86e2-896f174d7e61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.525449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d62bd21c-7cd8-4e8b-86e2-896f174d7e61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.525878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d62bd21c-7cd8-4e8b-86e2-896f174d7e61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.668005 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d62bd21c-7cd8-4e8b-86e2-896f174d7e61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:36.676328 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d62bd21c-7cd8-4e8b-86e2-896f174d7e61 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.163803 May 16 15:16:36.676909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 99/188] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:36 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:36.744995 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-365f604a-3614-478c-9f67-4e62ff3bc264 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:36.745516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-365f604a-3614-478c-9f67-4e62ff3bc264 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:36.751905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-365f604a-3614-478c-9f67-4e62ff3bc264 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.752356 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-365f604a-3614-478c-9f67-4e62ff3bc264 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.753136 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-365f604a-3614-478c-9f67-4e62ff3bc264 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.753563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-365f604a-3614-478c-9f67-4e62ff3bc264 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.825919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-365f604a-3614-478c-9f67-4e62ff3bc264 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:36.833874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-365f604a-3614-478c-9f67-4e62ff3bc264 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1290 microversion: 2.1 time: 0.092829 May 16 15:16:36.834450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 90/189] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:36 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:37.693380 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-324753bc-3107-4942-92cd-36d8b7cc9939 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:37.694027 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-324753bc-3107-4942-92cd-36d8b7cc9939 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:37.699905 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-324753bc-3107-4942-92cd-36d8b7cc9939 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.700352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-324753bc-3107-4942-92cd-36d8b7cc9939 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.701739 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-324753bc-3107-4942-92cd-36d8b7cc9939 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.701739 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-324753bc-3107-4942-92cd-36d8b7cc9939 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.828343 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-324753bc-3107-4942-92cd-36d8b7cc9939 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:37.837382 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-324753bc-3107-4942-92cd-36d8b7cc9939 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1523 microversion: 2.1 time: 0.147785 May 16 15:16:37.838128 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 100/190] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:37 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:37.852015 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-44f6f4bb-eeaa-4ae7-87c8-3959694f60e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:37.852628 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-44f6f4bb-eeaa-4ae7-87c8-3959694f60e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:37.858771 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-44f6f4bb-eeaa-4ae7-87c8-3959694f60e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.859219 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-44f6f4bb-eeaa-4ae7-87c8-3959694f60e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.860022 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-44f6f4bb-eeaa-4ae7-87c8-3959694f60e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.860455 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-44f6f4bb-eeaa-4ae7-87c8-3959694f60e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.934856 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-44f6f4bb-eeaa-4ae7-87c8-3959694f60e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:37.942809 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-44f6f4bb-eeaa-4ae7-87c8-3959694f60e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1298 microversion: 2.1 time: 0.094574 May 16 15:16:37.943373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 91/191] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:37 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:38.854253 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c50346ec-3a65-4f66-a4eb-0e72aef63037 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:38.854887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c50346ec-3a65-4f66-a4eb-0e72aef63037 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:38.860727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c50346ec-3a65-4f66-a4eb-0e72aef63037 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:38.861176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c50346ec-3a65-4f66-a4eb-0e72aef63037 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:38.862563 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c50346ec-3a65-4f66-a4eb-0e72aef63037 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:38.863017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c50346ec-3a65-4f66-a4eb-0e72aef63037 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:38.961120 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-08c96a74-55b2-413e-980d-7d5ad6f8f080 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:38.961742 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-08c96a74-55b2-413e-980d-7d5ad6f8f080 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:38.968190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-08c96a74-55b2-413e-980d-7d5ad6f8f080 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:38.968652 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-08c96a74-55b2-413e-980d-7d5ad6f8f080 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:38.969446 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-08c96a74-55b2-413e-980d-7d5ad6f8f080 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:38.969881 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-08c96a74-55b2-413e-980d-7d5ad6f8f080 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.387016 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c50346ec-3a65-4f66-a4eb-0e72aef63037 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:39.394857 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c50346ec-3a65-4f66-a4eb-0e72aef63037 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1503 microversion: 2.1 time: 0.544542 May 16 15:16:39.395443 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 101/192] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:38 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1503 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:39.423294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-be198733-73fb-4e7a-8bc1-d7e9ef02e71b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:39.423294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-be198733-73fb-4e7a-8bc1-d7e9ef02e71b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:39.426454 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-08c96a74-55b2-413e-980d-7d5ad6f8f080 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:39.429482 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-be198733-73fb-4e7a-8bc1-d7e9ef02e71b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.431264 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-be198733-73fb-4e7a-8bc1-d7e9ef02e71b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.432434 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-be198733-73fb-4e7a-8bc1-d7e9ef02e71b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.433027 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-be198733-73fb-4e7a-8bc1-d7e9ef02e71b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.436267 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-08c96a74-55b2-413e-980d-7d5ad6f8f080 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.478993 May 16 15:16:39.447444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 92/193] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:38 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:39.659789 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-be198733-73fb-4e7a-8bc1-d7e9ef02e71b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:39.667298 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-be198733-73fb-4e7a-8bc1-d7e9ef02e71b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1517 microversion: 2.1 time: 0.257178 May 16 15:16:39.667900 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 102/194] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:39 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:40.444000 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-9162a243-92f1-4f55-bcb2-3f41a5b10d2c req-cd14a0ad-a9a7-464e-be7c-5728fa0a139c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccced799-d35d-4fcc-81d1-df03942c2394", "tag": "fb596391-d69d-41f8-b5d1-5cdf514becf8"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:40.449221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-9162a243-92f1-4f55-bcb2-3f41a5b10d2c req-cd14a0ad-a9a7-464e-be7c-5728fa0a139c service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:40.449221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-9162a243-92f1-4f55-bcb2-3f41a5b10d2c req-cd14a0ad-a9a7-464e-be7c-5728fa0a139c service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:40.456191 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-80852257-426e-4b6c-9f82-9e96ef70a7a3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:40.456730 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-80852257-426e-4b6c-9f82-9e96ef70a7a3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:40.473636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-80852257-426e-4b6c-9f82-9e96ef70a7a3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:40.473636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-80852257-426e-4b6c-9f82-9e96ef70a7a3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:40.473636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-80852257-426e-4b6c-9f82-9e96ef70a7a3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:40.473636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-80852257-426e-4b6c-9f82-9e96ef70a7a3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:40.476363 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-9162a243-92f1-4f55-bcb2-3f41a5b10d2c req-cd14a0ad-a9a7-464e-be7c-5728fa0a139c service nova] Creating event network-changed:fb596391-d69d-41f8-b5d1-5cdf514becf8 for instance ccced799-d35d-4fcc-81d1-df03942c2394 on hv-cinder-84175 May 16 15:16:40.482259 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-9162a243-92f1-4f55-bcb2-3f41a5b10d2c req-cd14a0ad-a9a7-464e-be7c-5728fa0a139c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049522 May 16 15:16:40.482767 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 93/195] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:40.677442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-80852257-426e-4b6c-9f82-9e96ef70a7a3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:40.685465 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-80852257-426e-4b6c-9f82-9e96ef70a7a3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.235096 May 16 15:16:40.686040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 103/196] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:40 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:41.704745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c1a5e72d-d3f6-4c27-85fe-a7115b63a10d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:41.705448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c1a5e72d-d3f6-4c27-85fe-a7115b63a10d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:41.711654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1a5e72d-d3f6-4c27-85fe-a7115b63a10d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:41.712114 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1a5e72d-d3f6-4c27-85fe-a7115b63a10d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:41.712890 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1a5e72d-d3f6-4c27-85fe-a7115b63a10d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:41.713333 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1a5e72d-d3f6-4c27-85fe-a7115b63a10d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:41.850152 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c1a5e72d-d3f6-4c27-85fe-a7115b63a10d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:41.858129 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c1a5e72d-d3f6-4c27-85fe-a7115b63a10d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.158097 May 16 15:16:41.858840 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 94/197] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:41 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:42.504700 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3151980b-c25c-4ca6-9ed8-0780464cf3d3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:42.505835 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3151980b-c25c-4ca6-9ed8-0780464cf3d3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:42.511710 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3151980b-c25c-4ca6-9ed8-0780464cf3d3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.512160 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3151980b-c25c-4ca6-9ed8-0780464cf3d3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:42.512930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3151980b-c25c-4ca6-9ed8-0780464cf3d3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.513368 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3151980b-c25c-4ca6-9ed8-0780464cf3d3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:42.537786 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-3151980b-c25c-4ca6-9ed8-0780464cf3d3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lazy-loading 'flavor' on Instance uuid 005c2b60-9000-4ab7-a297-367fe59e2dfb {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:16:42.853909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3151980b-c25c-4ca6-9ed8-0780464cf3d3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb/action" status: 200 len: 32 microversion: 2.1 time: 0.354419 May 16 15:16:42.854540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 104/198] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:16:42 2022] POST /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb/action => generated 32 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:16:42.864598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-511f59df-cd73-46e6-a360-a730d2c8ef08 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:42.865434 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-511f59df-cd73-46e6-a360-a730d2c8ef08 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:42.873090 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-511f59df-cd73-46e6-a360-a730d2c8ef08 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.873860 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-511f59df-cd73-46e6-a360-a730d2c8ef08 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:42.874988 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-511f59df-cd73-46e6-a360-a730d2c8ef08 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.880544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-69527a4c-ab8a-4ea3-ad6b-043825f01634 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:42.881644 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-69527a4c-ab8a-4ea3-ad6b-043825f01634 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:42.882124 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-511f59df-cd73-46e6-a360-a730d2c8ef08 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:42.890177 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-69527a4c-ab8a-4ea3-ad6b-043825f01634 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.890879 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-69527a4c-ab8a-4ea3-ad6b-043825f01634 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:42.891895 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-69527a4c-ab8a-4ea3-ad6b-043825f01634 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.892553 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-69527a4c-ab8a-4ea3-ad6b-043825f01634 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:43.325299 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-511f59df-cd73-46e6-a360-a730d2c8ef08 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:43.337141 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-511f59df-cd73-46e6-a360-a730d2c8ef08 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.476743 May 16 15:16:43.338558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 95/199] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:42 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:43.481016 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-69527a4c-ab8a-4ea3-ad6b-043825f01634 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:43.491759 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-69527a4c-ab8a-4ea3-ad6b-043825f01634 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.616867 May 16 15:16:43.492717 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 105/200] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:42 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:44.356665 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0a971a06-12bb-42b7-a52a-eef7be8984d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:44.357286 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0a971a06-12bb-42b7-a52a-eef7be8984d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:44.364608 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a971a06-12bb-42b7-a52a-eef7be8984d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:44.365062 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a971a06-12bb-42b7-a52a-eef7be8984d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:44.366641 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a971a06-12bb-42b7-a52a-eef7be8984d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:44.366641 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a971a06-12bb-42b7-a52a-eef7be8984d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:44.509205 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-98e1d30f-a75b-4f6e-afcb-10900bcd4220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:44.509924 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-98e1d30f-a75b-4f6e-afcb-10900bcd4220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:44.517304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0a971a06-12bb-42b7-a52a-eef7be8984d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:44.517566 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-98e1d30f-a75b-4f6e-afcb-10900bcd4220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:44.517566 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-98e1d30f-a75b-4f6e-afcb-10900bcd4220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:44.517566 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-98e1d30f-a75b-4f6e-afcb-10900bcd4220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:44.518001 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-98e1d30f-a75b-4f6e-afcb-10900bcd4220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:44.523511 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0a971a06-12bb-42b7-a52a-eef7be8984d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.170393 May 16 15:16:44.524431 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 96/201] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:44 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:44.656207 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-98e1d30f-a75b-4f6e-afcb-10900bcd4220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:44.664760 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-98e1d30f-a75b-4f6e-afcb-10900bcd4220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.159403 May 16 15:16:44.665635 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 106/202] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:44 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:45.543065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d29728b8-4f12-4183-875b-dce72fa3ff17 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:45.543692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d29728b8-4f12-4183-875b-dce72fa3ff17 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:45.551293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d29728b8-4f12-4183-875b-dce72fa3ff17 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:45.551758 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d29728b8-4f12-4183-875b-dce72fa3ff17 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:45.552575 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d29728b8-4f12-4183-875b-dce72fa3ff17 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:45.553008 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d29728b8-4f12-4183-875b-dce72fa3ff17 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:45.682770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3f55755b-7496-48d7-ad26-6d914151b3a2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:45.683351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3f55755b-7496-48d7-ad26-6d914151b3a2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:45.689263 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d29728b8-4f12-4183-875b-dce72fa3ff17 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:45.689435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f55755b-7496-48d7-ad26-6d914151b3a2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:45.690026 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f55755b-7496-48d7-ad26-6d914151b3a2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:45.690839 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f55755b-7496-48d7-ad26-6d914151b3a2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:45.691278 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f55755b-7496-48d7-ad26-6d914151b3a2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:45.696924 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d29728b8-4f12-4183-875b-dce72fa3ff17 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.157753 May 16 15:16:45.697571 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 97/203] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:45 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:45.838299 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3f55755b-7496-48d7-ad26-6d914151b3a2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:45.856334 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3f55755b-7496-48d7-ad26-6d914151b3a2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.177691 May 16 15:16:45.857547 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 107/204] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:45 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:46.714410 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8afcdf54-e43a-4af1-8ff9-f70f976e11db tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:46.715914 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8afcdf54-e43a-4af1-8ff9-f70f976e11db tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:46.723424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8afcdf54-e43a-4af1-8ff9-f70f976e11db tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:46.723976 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8afcdf54-e43a-4af1-8ff9-f70f976e11db tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:46.724805 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8afcdf54-e43a-4af1-8ff9-f70f976e11db tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:46.725303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8afcdf54-e43a-4af1-8ff9-f70f976e11db tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:46.791207 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-1f41ecb0-7a01-40ae-94ea-33c3405fff19 req-051adb11-cb7b-43d9-8e16-bcea8f795056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccced799-d35d-4fcc-81d1-df03942c2394", "name": "network-vif-plugged", "status": "completed", "tag": "fb596391-d69d-41f8-b5d1-5cdf514becf8"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:46.799951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-1f41ecb0-7a01-40ae-94ea-33c3405fff19 req-051adb11-cb7b-43d9-8e16-bcea8f795056 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:46.800402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-1f41ecb0-7a01-40ae-94ea-33c3405fff19 req-051adb11-cb7b-43d9-8e16-bcea8f795056 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:46.813466 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-1f41ecb0-7a01-40ae-94ea-33c3405fff19 req-051adb11-cb7b-43d9-8e16-bcea8f795056 service nova] Creating event network-vif-plugged:fb596391-d69d-41f8-b5d1-5cdf514becf8 for instance ccced799-d35d-4fcc-81d1-df03942c2394 on hv-cinder-84175 May 16 15:16:46.818727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-1f41ecb0-7a01-40ae-94ea-33c3405fff19 req-051adb11-cb7b-43d9-8e16-bcea8f795056 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031192 May 16 15:16:46.819434 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 108/205] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:16:46.903648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-08fe3bff-e9dd-4452-b78f-375c44879e74 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:46.907668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-08fe3bff-e9dd-4452-b78f-375c44879e74 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:46.919054 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-08fe3bff-e9dd-4452-b78f-375c44879e74 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:46.919505 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-08fe3bff-e9dd-4452-b78f-375c44879e74 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:46.920319 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-08fe3bff-e9dd-4452-b78f-375c44879e74 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:46.920757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-08fe3bff-e9dd-4452-b78f-375c44879e74 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:47.107964 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-8afcdf54-e43a-4af1-8ff9-f70f976e11db tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:47.119737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8afcdf54-e43a-4af1-8ff9-f70f976e11db tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.406272 May 16 15:16:47.119737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 98/206] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:46 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:47.119942 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-08fe3bff-e9dd-4452-b78f-375c44879e74 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:47.127563 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-08fe3bff-e9dd-4452-b78f-375c44879e74 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.247195 May 16 15:16:47.128326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 109/207] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:46 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:48.134768 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ee8c0cc4-8ea5-4f81-bad9-624fd7af18e3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.135402 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ee8c0cc4-8ea5-4f81-bad9-624fd7af18e3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:48.141709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee8c0cc4-8ea5-4f81-bad9-624fd7af18e3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:48.142162 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee8c0cc4-8ea5-4f81-bad9-624fd7af18e3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:48.143516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee8c0cc4-8ea5-4f81-bad9-624fd7af18e3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:48.144028 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee8c0cc4-8ea5-4f81-bad9-624fd7af18e3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:48.145079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-19650fad-da41-4793-b263-10f7c0b8b676 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.145692 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-19650fad-da41-4793-b263-10f7c0b8b676 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:48.151806 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-19650fad-da41-4793-b263-10f7c0b8b676 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:48.152256 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-19650fad-da41-4793-b263-10f7c0b8b676 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:48.153021 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-19650fad-da41-4793-b263-10f7c0b8b676 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:48.153450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-19650fad-da41-4793-b263-10f7c0b8b676 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:48.351732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ee8c0cc4-8ea5-4f81-bad9-624fd7af18e3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:48.357289 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-19650fad-da41-4793-b263-10f7c0b8b676 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:48.359862 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ee8c0cc4-8ea5-4f81-bad9-624fd7af18e3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.228958 May 16 15:16:48.360450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 99/208] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:48.365281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-19650fad-da41-4793-b263-10f7c0b8b676 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.225043 May 16 15:16:48.365855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 110/209] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:49.378191 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c884b6fc-65c2-404f-a1eb-6e9b9d65b45b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:49.378838 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c884b6fc-65c2-404f-a1eb-6e9b9d65b45b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:49.382206 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-81e2a6de-8b5c-456a-8947-3f3725643f60 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:49.382822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-81e2a6de-8b5c-456a-8947-3f3725643f60 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:49.385322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c884b6fc-65c2-404f-a1eb-6e9b9d65b45b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:49.385771 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c884b6fc-65c2-404f-a1eb-6e9b9d65b45b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.386545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c884b6fc-65c2-404f-a1eb-6e9b9d65b45b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:49.386986 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c884b6fc-65c2-404f-a1eb-6e9b9d65b45b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.388738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-81e2a6de-8b5c-456a-8947-3f3725643f60 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:49.389192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-81e2a6de-8b5c-456a-8947-3f3725643f60 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.389945 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-81e2a6de-8b5c-456a-8947-3f3725643f60 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:49.390384 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-81e2a6de-8b5c-456a-8947-3f3725643f60 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.582063 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c884b6fc-65c2-404f-a1eb-6e9b9d65b45b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:49.585955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-81e2a6de-8b5c-456a-8947-3f3725643f60 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:49.589557 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c884b6fc-65c2-404f-a1eb-6e9b9d65b45b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.215699 May 16 15:16:49.590224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 100/210] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:49 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:49.593583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-81e2a6de-8b5c-456a-8947-3f3725643f60 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.215100 May 16 15:16:49.594146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 111/211] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:49 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:50.606014 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0466b67a-230b-46a4-ac04-f4feae5df947 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:50.606623 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0466b67a-230b-46a4-ac04-f4feae5df947 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:50.609846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c0b2cb68-6ec6-4d93-84b0-cb6f0cbf10e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:50.610494 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c0b2cb68-6ec6-4d93-84b0-cb6f0cbf10e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:50.613505 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0466b67a-230b-46a4-ac04-f4feae5df947 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:50.613962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0466b67a-230b-46a4-ac04-f4feae5df947 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:50.614739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0466b67a-230b-46a4-ac04-f4feae5df947 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:50.615178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0466b67a-230b-46a4-ac04-f4feae5df947 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:50.616409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c0b2cb68-6ec6-4d93-84b0-cb6f0cbf10e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:50.616853 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c0b2cb68-6ec6-4d93-84b0-cb6f0cbf10e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:50.617613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c0b2cb68-6ec6-4d93-84b0-cb6f0cbf10e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:50.618046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c0b2cb68-6ec6-4d93-84b0-cb6f0cbf10e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:50.811903 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0466b67a-230b-46a4-ac04-f4feae5df947 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:50.814613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c0b2cb68-6ec6-4d93-84b0-cb6f0cbf10e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:50.819804 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0466b67a-230b-46a4-ac04-f4feae5df947 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.217448 May 16 15:16:50.820587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 101/212] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:50 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:50.822396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c0b2cb68-6ec6-4d93-84b0-cb6f0cbf10e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.216343 May 16 15:16:50.822949 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 112/213] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:50 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:51.837796 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-803b5d14-4d55-48b8-92ac-dc985d5df4ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:51.838599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3e4033e6-ad32-4601-ac70-e6ca2a2cde56 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:51.838965 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-803b5d14-4d55-48b8-92ac-dc985d5df4ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:51.839223 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3e4033e6-ad32-4601-ac70-e6ca2a2cde56 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:51.845698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3e4033e6-ad32-4601-ac70-e6ca2a2cde56 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:51.846386 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3e4033e6-ad32-4601-ac70-e6ca2a2cde56 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:51.848279 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3e4033e6-ad32-4601-ac70-e6ca2a2cde56 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:51.849503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3e4033e6-ad32-4601-ac70-e6ca2a2cde56 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:51.851517 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-803b5d14-4d55-48b8-92ac-dc985d5df4ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:51.852115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-803b5d14-4d55-48b8-92ac-dc985d5df4ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:51.853618 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-803b5d14-4d55-48b8-92ac-dc985d5df4ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:51.854072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-803b5d14-4d55-48b8-92ac-dc985d5df4ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:52.090904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3e4033e6-ad32-4601-ac70-e6ca2a2cde56 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:52.092810 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-803b5d14-4d55-48b8-92ac-dc985d5df4ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:52.101663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-803b5d14-4d55-48b8-92ac-dc985d5df4ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.267897 May 16 15:16:52.102869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 102/214] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:51 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:52.106028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3e4033e6-ad32-4601-ac70-e6ca2a2cde56 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1364 microversion: 2.1 time: 0.271496 May 16 15:16:52.116785 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 113/215] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:51 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:53.120856 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ca0c91bf-966d-4c72-9c5c-d6fea79304d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:53.121666 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ca0c91bf-966d-4c72-9c5c-d6fea79304d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:53.124709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4b52c383-1b95-471b-a58b-8141b59ba0b9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:53.125875 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4b52c383-1b95-471b-a58b-8141b59ba0b9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:53.132686 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ca0c91bf-966d-4c72-9c5c-d6fea79304d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:53.133341 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ca0c91bf-966d-4c72-9c5c-d6fea79304d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:53.134029 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b52c383-1b95-471b-a58b-8141b59ba0b9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:53.134135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ca0c91bf-966d-4c72-9c5c-d6fea79304d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:53.134854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b52c383-1b95-471b-a58b-8141b59ba0b9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:53.134944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ca0c91bf-966d-4c72-9c5c-d6fea79304d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:53.135435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b52c383-1b95-471b-a58b-8141b59ba0b9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:53.136132 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4b52c383-1b95-471b-a58b-8141b59ba0b9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:53.326313 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4b52c383-1b95-471b-a58b-8141b59ba0b9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:53.333082 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ca0c91bf-966d-4c72-9c5c-d6fea79304d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:53.336422 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4b52c383-1b95-471b-a58b-8141b59ba0b9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1550 microversion: 2.1 time: 0.216150 May 16 15:16:53.337014 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 114/216] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:53 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1550 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:53.340789 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ca0c91bf-966d-4c72-9c5c-d6fea79304d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.224705 May 16 15:16:53.350196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 103/217] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:53 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:53.357152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5478590e-df57-44ec-8e22-683f0d1cb1b6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:53.357655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5478590e-df57-44ec-8e22-683f0d1cb1b6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:53.364594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5478590e-df57-44ec-8e22-683f0d1cb1b6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:53.365143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5478590e-df57-44ec-8e22-683f0d1cb1b6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:53.365903 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5478590e-df57-44ec-8e22-683f0d1cb1b6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:53.366331 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5478590e-df57-44ec-8e22-683f0d1cb1b6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:53.445514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5478590e-df57-44ec-8e22-683f0d1cb1b6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092137 May 16 15:16:53.446106 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 115/218] 10.222.0.71 () {58 vars in 1274 bytes} [Mon May 16 15:16:53 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:54.357574 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-77191b23-a2a0-4c5f-a64e-a2a5cb9c0fab tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:54.358419 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-77191b23-a2a0-4c5f-a64e-a2a5cb9c0fab tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:54.364916 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-77191b23-a2a0-4c5f-a64e-a2a5cb9c0fab tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:54.365363 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-77191b23-a2a0-4c5f-a64e-a2a5cb9c0fab tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:54.366135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-77191b23-a2a0-4c5f-a64e-a2a5cb9c0fab tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:54.366568 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-77191b23-a2a0-4c5f-a64e-a2a5cb9c0fab tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:54.599370 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-77191b23-a2a0-4c5f-a64e-a2a5cb9c0fab tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:54.609528 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-77191b23-a2a0-4c5f-a64e-a2a5cb9c0fab tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.255715 May 16 15:16:54.610111 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 104/219] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:54 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:54.802290 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-5565b64f-650b-4480-8476-a8806ea9aae2 req-8bfec1e1-0859-4696-b25c-6fd2d810675f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccced799-d35d-4fcc-81d1-df03942c2394", "tag": "fb596391-d69d-41f8-b5d1-5cdf514becf8"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:54.811104 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-5565b64f-650b-4480-8476-a8806ea9aae2 req-8bfec1e1-0859-4696-b25c-6fd2d810675f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:54.817143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-5565b64f-650b-4480-8476-a8806ea9aae2 req-8bfec1e1-0859-4696-b25c-6fd2d810675f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:54.822606 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-5565b64f-650b-4480-8476-a8806ea9aae2 req-8bfec1e1-0859-4696-b25c-6fd2d810675f service nova] Creating event network-changed:fb596391-d69d-41f8-b5d1-5cdf514becf8 for instance ccced799-d35d-4fcc-81d1-df03942c2394 on hv-cinder-84175 May 16 15:16:54.827945 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-5565b64f-650b-4480-8476-a8806ea9aae2 req-8bfec1e1-0859-4696-b25c-6fd2d810675f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029400 May 16 15:16:54.828574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 116/220] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:55.642263 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-399217cb-83df-4cff-a9e8-8f0d187f9742 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:55.645331 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-399217cb-83df-4cff-a9e8-8f0d187f9742 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:55.656461 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-399217cb-83df-4cff-a9e8-8f0d187f9742 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:55.657434 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-399217cb-83df-4cff-a9e8-8f0d187f9742 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:55.658690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-399217cb-83df-4cff-a9e8-8f0d187f9742 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:55.659444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-399217cb-83df-4cff-a9e8-8f0d187f9742 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:55.837893 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-399217cb-83df-4cff-a9e8-8f0d187f9742 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:55.855073 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-399217cb-83df-4cff-a9e8-8f0d187f9742 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.216909 May 16 15:16:55.855073 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 105/221] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:55 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:56.869120 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-48060b3d-548f-43b1-b4d5-873964fdf869 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:56.869729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-48060b3d-548f-43b1-b4d5-873964fdf869 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:56.876256 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48060b3d-548f-43b1-b4d5-873964fdf869 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:56.876709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48060b3d-548f-43b1-b4d5-873964fdf869 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:56.877548 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48060b3d-548f-43b1-b4d5-873964fdf869 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:56.878169 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48060b3d-548f-43b1-b4d5-873964fdf869 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:57.009691 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-48060b3d-548f-43b1-b4d5-873964fdf869 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:57.017091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-48060b3d-548f-43b1-b4d5-873964fdf869 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.152289 May 16 15:16:57.017652 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 117/222] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:56 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:58.034834 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-275f703d-aeab-4810-845e-e3e7b5979636 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:58.035520 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-275f703d-aeab-4810-845e-e3e7b5979636 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:58.042203 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-275f703d-aeab-4810-845e-e3e7b5979636 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.042647 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-275f703d-aeab-4810-845e-e3e7b5979636 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.043415 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-275f703d-aeab-4810-845e-e3e7b5979636 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.043926 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-275f703d-aeab-4810-845e-e3e7b5979636 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.172729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-275f703d-aeab-4810-845e-e3e7b5979636 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:58.180927 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-275f703d-aeab-4810-845e-e3e7b5979636 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.150317 May 16 15:16:58.181498 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 106/223] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:58 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:58.270382 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c060262f-6527-474b-85a3-e52b2dd34dc4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:58.270881 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c060262f-6527-474b-85a3-e52b2dd34dc4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:58.276955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c060262f-6527-474b-85a3-e52b2dd34dc4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.277348 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c060262f-6527-474b-85a3-e52b2dd34dc4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.278111 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c060262f-6527-474b-85a3-e52b2dd34dc4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.278543 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c060262f-6527-474b-85a3-e52b2dd34dc4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.301086 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c060262f-6527-474b-85a3-e52b2dd34dc4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/ips" status: 200 len: 151 microversion: 2.1 time: 0.034728 May 16 15:16:58.302508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 118/224] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:16:58 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:59.198403 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d5f9c6d6-496e-4082-8fe9-c2757224e268 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:59.199016 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d5f9c6d6-496e-4082-8fe9-c2757224e268 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:59.205613 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5f9c6d6-496e-4082-8fe9-c2757224e268 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:59.206072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5f9c6d6-496e-4082-8fe9-c2757224e268 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:59.206850 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5f9c6d6-496e-4082-8fe9-c2757224e268 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:59.207284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5f9c6d6-496e-4082-8fe9-c2757224e268 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:59.345506 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d5f9c6d6-496e-4082-8fe9-c2757224e268 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:59.353608 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d5f9c6d6-496e-4082-8fe9-c2757224e268 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.159074 May 16 15:16:59.354484 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 107/225] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:16:59 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:00.029115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d49be437-9cb8-46b4-95ff-e9d4e6f8e565 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e3fa26d-3886-4e95-b115-3b0dd5141036"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:00.030240 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d49be437-9cb8-46b4-95ff-e9d4e6f8e565 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:00.038019 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d49be437-9cb8-46b4-95ff-e9d4e6f8e565 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:00.038584 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d49be437-9cb8-46b4-95ff-e9d4e6f8e565 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:00.039535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d49be437-9cb8-46b4-95ff-e9d4e6f8e565 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:00.040082 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d49be437-9cb8-46b4-95ff-e9d4e6f8e565 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:00.370115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1feb143e-6de9-4e89-b534-2b1a168e8c0d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:00.370727 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1feb143e-6de9-4e89-b534-2b1a168e8c0d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:00.376956 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1feb143e-6de9-4e89-b534-2b1a168e8c0d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:00.377401 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1feb143e-6de9-4e89-b534-2b1a168e8c0d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:00.378162 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1feb143e-6de9-4e89-b534-2b1a168e8c0d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:00.378591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1feb143e-6de9-4e89-b534-2b1a168e8c0d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:00.514959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1feb143e-6de9-4e89-b534-2b1a168e8c0d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:00.524218 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1feb143e-6de9-4e89-b534-2b1a168e8c0d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.157804 May 16 15:17:00.530957 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 108/226] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:00 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:01.169811 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d49be437-9cb8-46b4-95ff-e9d4e6f8e565 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.144174 May 16 15:17:01.170328 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 119/227] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:17:00 2022] POST /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments => generated 194 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:01.541992 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2b343c4a-d5cb-404d-a161-5b3a6ff283f4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:01.542572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2b343c4a-d5cb-404d-a161-5b3a6ff283f4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:01.549085 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2b343c4a-d5cb-404d-a161-5b3a6ff283f4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:01.549539 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2b343c4a-d5cb-404d-a161-5b3a6ff283f4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:01.550310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2b343c4a-d5cb-404d-a161-5b3a6ff283f4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:01.550744 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2b343c4a-d5cb-404d-a161-5b3a6ff283f4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:01.569242 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-97b80303-3288-45a3-a13a-38b3b3fd463a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:01.569852 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-97b80303-3288-45a3-a13a-38b3b3fd463a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:01.575921 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-97b80303-3288-45a3-a13a-38b3b3fd463a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:01.576384 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-97b80303-3288-45a3-a13a-38b3b3fd463a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:01.577158 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-97b80303-3288-45a3-a13a-38b3b3fd463a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:01.577594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-97b80303-3288-45a3-a13a-38b3b3fd463a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:01.602441 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-97b80303-3288-45a3-a13a-38b3b3fd463a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037736 May 16 15:17:01.603172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 120/228] 10.222.0.71 () {60 vars in 1288 bytes} [Mon May 16 15:17:01 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:17:01.688311 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2b343c4a-d5cb-404d-a161-5b3a6ff283f4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:01.696754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2b343c4a-d5cb-404d-a161-5b3a6ff283f4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.158508 May 16 15:17:01.697334 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 109/229] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:01 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:02.715085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-11927c6e-285f-4ae9-98ac-da9db89fee49 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:02.715734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-11927c6e-285f-4ae9-98ac-da9db89fee49 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:02.727563 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-11927c6e-285f-4ae9-98ac-da9db89fee49 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.728238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-11927c6e-285f-4ae9-98ac-da9db89fee49 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.729154 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-11927c6e-285f-4ae9-98ac-da9db89fee49 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.729786 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-11927c6e-285f-4ae9-98ac-da9db89fee49 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.864247 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-11927c6e-285f-4ae9-98ac-da9db89fee49 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:02.878218 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-11927c6e-285f-4ae9-98ac-da9db89fee49 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1503 microversion: 2.1 time: 0.166894 May 16 15:17:02.888002 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 121/230] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:02 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:02.895350 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2df12e3f-24f9-4d38-a6a2-0e94c6db6cca"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:02.898683 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:02.903440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.904137 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.904967 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.905408 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.932337 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] HTTP exception thrown: Cannot 'attach_volume' instance 005c2b60-9000-4ab7-a297-367fe59e2dfb while it is in vm_state rescued May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Request method failure captured: May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: POST /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb/os-volume_attachments HTTP/1.1 May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 74 May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqGYNjACNTPuCxQ5tAZjCeNsclj3zBLZYCT0GzhAYLlpUn7x7SwrEZyHipo_-S1Q3XoVpY2bMG8R1hUmX1nlVK9ChFgSDPfiZHV59Z455s8uTYO82BgZA5rt6rI8q4vWGnMjFPQikO1qUS6XBYaU0uepOS4NRKl-OUss-l4Cc_aveg May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:17:02.934039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}] May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 97021ddaffff4e088961ba1873a8e697 May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {"volumeAttachment": {"volumeId": "2df12e3f-24f9-4d38-a6a2-0e94c6db6cca"}} May 16 15:17:02.935508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Cannot 'attach_volume' instance 005c2b60-9000-4ab7-a297-367fe59e2dfb while it is in vm_state rescued May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'server_id': '005c2b60-9000-4ab7-a297-367fe59e2dfb', 'body': {'volumeAttachment': {'volumeId': '2df12e3f-24f9-4d38-a6a2-0e94c6db6cca'}}} May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 005c2b60-9000-4ab7-a297-367fe59e2dfb in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:17:02.940213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 005c2b60-9000-4ab7-a297-367fe59e2dfb while it is in vm_state rescued May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:17:02.941642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:17:02.943541 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:17:02.943541 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:17:02.943541 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 005c2b60-9000-4ab7-a297-367fe59e2dfb while it is in vm_state rescued May 16 15:17:02.943541 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:17:02.943541 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Returning 409 to user: Cannot 'attach_volume' instance 005c2b60-9000-4ab7-a297-367fe59e2dfb while it is in vm_state rescued {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:17:02.943541 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7b192d5d-2474-409f-9f35-ee0a95691d06 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044320 May 16 15:17:02.943541 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 110/231] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:17:02 2022] POST /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 15:17:02.947131 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cb57563b-0922-4128-ac45-8a36c6d02fa3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:02.947692 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cb57563b-0922-4128-ac45-8a36c6d02fa3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:02.954620 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb57563b-0922-4128-ac45-8a36c6d02fa3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.955069 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb57563b-0922-4128-ac45-8a36c6d02fa3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.955908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb57563b-0922-4128-ac45-8a36c6d02fa3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.956511 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb57563b-0922-4128-ac45-8a36c6d02fa3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.189197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cb57563b-0922-4128-ac45-8a36c6d02fa3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.246455 May 16 15:17:03.190046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 122/232] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:17:02 2022] POST /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:17:03.198736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ad6a37b9-bc63-45a8-9d68-d099dcab4e98 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:03.199533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ad6a37b9-bc63-45a8-9d68-d099dcab4e98 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:03.205389 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ad6a37b9-bc63-45a8-9d68-d099dcab4e98 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:03.205834 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ad6a37b9-bc63-45a8-9d68-d099dcab4e98 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.206598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ad6a37b9-bc63-45a8-9d68-d099dcab4e98 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:03.207028 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ad6a37b9-bc63-45a8-9d68-d099dcab4e98 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.393886 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ad6a37b9-bc63-45a8-9d68-d099dcab4e98 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:03.411212 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ad6a37b9-bc63-45a8-9d68-d099dcab4e98 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1511 microversion: 2.1 time: 0.216425 May 16 15:17:03.411827 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 111/233] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:03 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:03.912307 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a29479df-c75b-4e85-8202-ce08bda52999 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:03.913264 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a29479df-c75b-4e85-8202-ce08bda52999 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:03.919910 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a29479df-c75b-4e85-8202-ce08bda52999 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:03.920369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a29479df-c75b-4e85-8202-ce08bda52999 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.921148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a29479df-c75b-4e85-8202-ce08bda52999 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:03.921592 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a29479df-c75b-4e85-8202-ce08bda52999 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.945145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-a29479df-c75b-4e85-8202-ce08bda52999 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lazy-loading 'flavor' on Instance uuid 893feede-4052-4c51-96a2-1f93510d1f5f {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:17:04.428128 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-948cc12f-0868-4578-8458-4206e536edbf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:04.429004 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-948cc12f-0868-4578-8458-4206e536edbf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:04.436515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-948cc12f-0868-4578-8458-4206e536edbf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.436961 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-948cc12f-0868-4578-8458-4206e536edbf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.437763 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-948cc12f-0868-4578-8458-4206e536edbf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.438240 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-948cc12f-0868-4578-8458-4206e536edbf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.533316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a29479df-c75b-4e85-8202-ce08bda52999 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/action" status: 202 len: 0 microversion: 2.20 time: 0.626235 May 16 15:17:04.533962 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 123/234] 10.222.0.71 () {62 vars in 1318 bytes} [Mon May 16 15:17:03 2022] POST /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:17:04.542893 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:04.543949 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:04.550601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.551060 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.551879 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.552984 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.605414 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-948cc12f-0868-4578-8458-4206e536edbf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:04.618722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-948cc12f-0868-4578-8458-4206e536edbf tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1511 microversion: 2.1 time: 0.192544 May 16 15:17:04.618722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 112/235] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:04 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:04.688604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:04.700407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:04.702267 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:04.703641 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-abe874b7-f8cd-4f05-969d-ad375a652447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.164916 May 16 15:17:04.705650 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 124/236] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:04 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:17:05.633690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2958f980-d671-4d46-8d11-d1b13be5ef81 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:05.634302 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2958f980-d671-4d46-8d11-d1b13be5ef81 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:05.640662 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2958f980-d671-4d46-8d11-d1b13be5ef81 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:05.641110 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2958f980-d671-4d46-8d11-d1b13be5ef81 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:05.641875 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2958f980-d671-4d46-8d11-d1b13be5ef81 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:05.642311 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2958f980-d671-4d46-8d11-d1b13be5ef81 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:05.723648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:05.724283 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:05.732336 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:05.732336 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:05.733108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:05.733542 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:05.776310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2958f980-d671-4d46-8d11-d1b13be5ef81 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:05.784177 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2958f980-d671-4d46-8d11-d1b13be5ef81 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1511 microversion: 2.1 time: 0.154675 May 16 15:17:05.785053 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 113/237] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:05 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:05.875306 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:05.884524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:05.886008 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:05.887166 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cb60d886-4099-44a4-b599-0a9e2339554c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.167598 May 16 15:17:05.887747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 125/238] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:05 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:17:06.802111 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-34e6c0c2-aecc-4ef8-aaa2-9aaa39236757 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:06.803388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-34e6c0c2-aecc-4ef8-aaa2-9aaa39236757 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:06.809766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-34e6c0c2-aecc-4ef8-aaa2-9aaa39236757 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:06.810214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-34e6c0c2-aecc-4ef8-aaa2-9aaa39236757 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:06.810983 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-34e6c0c2-aecc-4ef8-aaa2-9aaa39236757 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:06.811584 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-34e6c0c2-aecc-4ef8-aaa2-9aaa39236757 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:06.907032 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:06.907667 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:06.916827 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:06.917446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:06.918091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:06.918526 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:07.080903 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-34e6c0c2-aecc-4ef8-aaa2-9aaa39236757 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:07.089754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-34e6c0c2-aecc-4ef8-aaa2-9aaa39236757 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1517 microversion: 2.1 time: 0.291391 May 16 15:17:07.090343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 114/239] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:06 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1517 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:07.112733 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:07.122925 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:07.124669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:07.125838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-77c34e1e-bdd3-4be4-b69c-859acb958ca9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.223375 May 16 15:17:07.126565 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 126/240] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:06 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:08.144288 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:08.144923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:08.151906 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:08.152349 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:08.153101 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:08.153527 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:08.285549 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:08.293439 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:08.294896 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:08.296067 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d86ed497-8bcb-4839-ab78-a80b906f4dc4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.155638 May 16 15:17:08.296622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 115/241] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:08 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:09.314608 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:09.315224 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:09.322896 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:09.323343 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:09.324139 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:09.324574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:09.456025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:09.464486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:09.465959 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:09.467102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e6aa30b1-493d-46c6-832e-347e8b2707b1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.156374 May 16 15:17:09.467680 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 127/242] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:09 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:10.484973 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:10.485657 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:10.492878 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:10.493330 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:10.494096 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:10.494531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:10.628142 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:10.636973 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:10.650834 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:10.650834 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a0bfdf3b-0e54-4450-bdf5-f292ae44b684 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.158526 May 16 15:17:10.650834 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 116/243] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:10 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:10.790731 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-42895482-286a-484e-a25b-7bc366706766 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'create', calling method: .version_select at 0x7f0c881764c0>, body: {"keypair": {"name": "tempest-keypair-491694629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJnbeUFpjmXpRpiQGkEPFS7S1Q64HDmPNXupltXLZQUAfd1iMhDhdQzWnNf98YGwilZ/PvLdO7e85FaW36L9ScqHGtQlkM95gAjhu6Hp81hmkRGEfR4OxsN9x9HmmS+KA=="}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:10.809531 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-42895482-286a-484e-a25b-7bc366706766 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Getting quotas for project e1e340fabe31456cb021fcd0b5f505b5. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:10.813406 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-42895482-286a-484e-a25b-7bc366706766 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Getting quotas for user 97021ddaffff4e088961ba1873a8e697 and project e1e340fabe31456cb021fcd0b5f505b5. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:10.931081 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-42895482-286a-484e-a25b-7bc366706766 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144939 May 16 15:17:10.931899 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 128/244] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:17:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:11.658407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:11.659124 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:11.665862 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:11.666311 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:11.667156 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:11.667636 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:11.807793 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:11.816309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:11.818065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:11.820316 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-55b83208-495a-4ca3-8b45-a7131d59e3c4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.165875 May 16 15:17:11.821307 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 117/245] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:11 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:11.944210 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b6d88402-9d9a-4206-b893-9586d4d00d3d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: .version_select at 0x7f0c88181790>, body: {"keypair": {"name": "tempest-keypair-923677161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJguaVbyxzvXS+J7yFnPMWVnxt2opC+LlJLENatNmgQVMadHJ69izmpWI+RlYrXX38h+cJnKRBm0ulCP72cEiZTofv793r1rWE+ZcoVe85BLnl0tR+KkozmNJh/8zVc2FQ=="}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:11.958441 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-b6d88402-9d9a-4206-b893-9586d4d00d3d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:11.962247 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-b6d88402-9d9a-4206-b893-9586d4d00d3d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for user d38cdf40e33b47d8aa79e029cded7503 and project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:12.073245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b6d88402-9d9a-4206-b893-9586d4d00d3d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133929 May 16 15:17:12.073847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 129/246] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:17:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:12.838731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:12.839972 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:12.847893 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:12.848357 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:12.849139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:12.849836 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:12.997478 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:13.005518 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:13.007190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:13.008373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9f73ee45-18bd-466f-8777-3424a9daad08 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.173764 May 16 15:17:13.008945 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 118/247] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:12 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:13.285056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-19801002", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be046d4b-8cff-4819-b7cd-e793c832b714"}], "security_groups": [{"name": "tempest-securitygroup--1172166448"}], "key_name": "tempest-keypair-491694629", "user_data": "}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:13.386205 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] validate_networks() for [('be046d4b-8cff-4819-b7cd-e793c832b714', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:17:13.766046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:17:13.766492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:17:13.766957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:17:13.767359 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:17:13.767853 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:17:13.777412 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:13.777897 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:13.778898 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:13.779336 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:13.796364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Getting quotas for project e1e340fabe31456cb021fcd0b5f505b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:13.800585 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Getting quotas for user 97021ddaffff4e088961ba1873a8e697 and project e1e340fabe31456cb021fcd0b5f505b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:13.814420 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:17:13.818807 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:17:13.965394 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7e2703c5-eb3d-4369-8b39-c2c68909cb51 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.685075 May 16 15:17:13.966247 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 130/248] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:17:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 15:17:13.976331 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2f00504b-c246-4e03-a824-9d08787b9c18 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:13.977055 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2f00504b-c246-4e03-a824-9d08787b9c18 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:14.026487 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:14.026977 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:14.037619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:14.038065 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.038836 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:14.039266 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.052670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2f00504b-c246-4e03-a824-9d08787b9c18 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:14.060587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2f00504b-c246-4e03-a824-9d08787b9c18 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1243 microversion: 2.1 time: 0.088518 May 16 15:17:14.061103 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 119/249] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:13 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:14.445518 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:14.450680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1731133325", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a605965-a559-434b-a7bc-1500d5306bfd"}], "security_groups": [{"name": "tempest-securitygroup--643001819"}], "key_name": "tempest-keypair-923677161", "user_data": "}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:14.454880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:14.456520 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:14.457941 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f2e77315-87f0-447b-85c6-0384e6e21fd1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.435438 May 16 15:17:14.458588 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 131/250] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:14 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:17:14.571566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] validate_networks() for [('1a605965-a559-434b-a7bc-1500d5306bfd', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:17:14.932204 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:17:14.932627 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:17:14.933127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:17:14.933533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:17:14.933941 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:17:14.942766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:14.943210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.944384 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:14.944824 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.962466 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:14.966543 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for user d38cdf40e33b47d8aa79e029cded7503 and project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:14.982423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:17:14.984731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:17:15.077668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1d44d038-a504-4347-866c-a3fc711c26cb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:15.078308 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1d44d038-a504-4347-866c-a3fc711c26cb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:15.084145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d44d038-a504-4347-866c-a3fc711c26cb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:15.084598 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d44d038-a504-4347-866c-a3fc711c26cb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:15.085358 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d44d038-a504-4347-866c-a3fc711c26cb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:15.085793 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d44d038-a504-4347-866c-a3fc711c26cb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:15.105912 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1b63b18f-9278-4592-8c6f-9d33e9382523 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.660288 May 16 15:17:15.106819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 120/251] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:17:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:17:15.117295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-cf83e6a1-8276-458c-8b1b-df62dad3a612 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:15.117907 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cf83e6a1-8276-458c-8b1b-df62dad3a612 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:15.162262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1d44d038-a504-4347-866c-a3fc711c26cb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:15.182314 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1d44d038-a504-4347-866c-a3fc711c26cb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1247 microversion: 2.1 time: 0.107350 May 16 15:17:15.182314 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 132/252] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:15 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1247 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:15.189546 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-cf83e6a1-8276-458c-8b1b-df62dad3a612 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:15.205550 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-cf83e6a1-8276-458c-8b1b-df62dad3a612 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1241 microversion: 2.1 time: 0.090075 May 16 15:17:15.205550 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 121/253] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:15 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:15.477810 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:15.478433 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:15.484950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:15.485284 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:15.486065 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:15.486510 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:15.621015 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:15.629676 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:15.631851 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:15.633050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f9d81c10-8b7a-45e8-ac33-c0990537898b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.160575 May 16 15:17:15.633643 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 133/254] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:15 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:16.198485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-11659eed-4f16-4e91-a012-dfe16e241a86 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:16.199432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-11659eed-4f16-4e91-a012-dfe16e241a86 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:16.206697 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-11659eed-4f16-4e91-a012-dfe16e241a86 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.207153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-11659eed-4f16-4e91-a012-dfe16e241a86 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.208249 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-11659eed-4f16-4e91-a012-dfe16e241a86 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.208691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-11659eed-4f16-4e91-a012-dfe16e241a86 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.220496 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3422c714-0ea3-4365-91a2-c682c696b660 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:16.221390 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3422c714-0ea3-4365-91a2-c682c696b660 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:16.228445 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3422c714-0ea3-4365-91a2-c682c696b660 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.229108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3422c714-0ea3-4365-91a2-c682c696b660 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.230588 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3422c714-0ea3-4365-91a2-c682c696b660 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.231184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3422c714-0ea3-4365-91a2-c682c696b660 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.325700 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3422c714-0ea3-4365-91a2-c682c696b660 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:16.327524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-11659eed-4f16-4e91-a012-dfe16e241a86 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:16.336328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-11659eed-4f16-4e91-a012-dfe16e241a86 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1303 microversion: 2.1 time: 0.141636 May 16 15:17:16.337742 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 122/255] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:16 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:16.347898 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3422c714-0ea3-4365-91a2-c682c696b660 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1245 microversion: 2.1 time: 0.131148 May 16 15:17:16.351675 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 134/256] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:16 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:16.652763 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:16.653698 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:16.672566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.676912 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.679274 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.679764 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.975772 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:16.975772 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:16.976237 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:16.976237 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c9f19b65-f19b-4b70-a8e8-e8b06808a204 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.243191 May 16 15:17:16.976237 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 123/257] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:16 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:17.354574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ba3e05ef-4327-42a9-986f-4d1b9a86f6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:17.357975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ba3e05ef-4327-42a9-986f-4d1b9a86f6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:17.361818 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ba3e05ef-4327-42a9-986f-4d1b9a86f6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.362266 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ba3e05ef-4327-42a9-986f-4d1b9a86f6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:17.363134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ba3e05ef-4327-42a9-986f-4d1b9a86f6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.363828 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ba3e05ef-4327-42a9-986f-4d1b9a86f6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:17.367306 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-66fbefcd-4995-43e1-af4f-e9e12446fde6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:17.368185 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-66fbefcd-4995-43e1-af4f-e9e12446fde6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:17.378155 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-66fbefcd-4995-43e1-af4f-e9e12446fde6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.381496 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-66fbefcd-4995-43e1-af4f-e9e12446fde6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:17.381496 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-66fbefcd-4995-43e1-af4f-e9e12446fde6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.381496 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-66fbefcd-4995-43e1-af4f-e9e12446fde6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:17.528879 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-66fbefcd-4995-43e1-af4f-e9e12446fde6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:17.536819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-66fbefcd-4995-43e1-af4f-e9e12446fde6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1301 microversion: 2.1 time: 0.175021 May 16 15:17:17.538028 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 124/258] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:17 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1301 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:17.726549 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ba3e05ef-4327-42a9-986f-4d1b9a86f6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:17.733947 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ba3e05ef-4327-42a9-986f-4d1b9a86f6a2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.383251 May 16 15:17:17.734527 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 135/259] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:17 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:17.988105 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:17.988992 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:17.996010 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.996426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.002784 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.003356 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.251558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:18.262364 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:18.266767 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:18.268119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7eebc1d0-e8df-4fb9-a97b-5aab86de48b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.283978 May 16 15:17:18.273195 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 125/260] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:17 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:18.533405 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-76d9cec3-642b-4dd0-8730-915ae24892f7 req-b47852c7-55b6-4a06-a74e-71af362d3360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d612141-6fe0-4d49-b1aa-071acc497104", "tag": "75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:18.543383 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-76d9cec3-642b-4dd0-8730-915ae24892f7 req-b47852c7-55b6-4a06-a74e-71af362d3360 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.544108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-76d9cec3-642b-4dd0-8730-915ae24892f7 req-b47852c7-55b6-4a06-a74e-71af362d3360 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.559540 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d8812460-3920-4dc3-b910-aacde0ed1326 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:18.559540 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d8812460-3920-4dc3-b910-aacde0ed1326 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:18.563642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d8812460-3920-4dc3-b910-aacde0ed1326 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.565602 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d8812460-3920-4dc3-b910-aacde0ed1326 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.566440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d8812460-3920-4dc3-b910-aacde0ed1326 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.566884 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d8812460-3920-4dc3-b910-aacde0ed1326 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.575747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-76d9cec3-642b-4dd0-8730-915ae24892f7 req-b47852c7-55b6-4a06-a74e-71af362d3360 service nova] Creating event network-changed:75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b for instance 4d612141-6fe0-4d49-b1aa-071acc497104 on hv-cinder-84175 May 16 15:17:18.589696 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-76d9cec3-642b-4dd0-8730-915ae24892f7 req-b47852c7-55b6-4a06-a74e-71af362d3360 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059171 May 16 15:17:18.591527 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 136/261] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:18.689115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d8812460-3920-4dc3-b910-aacde0ed1326 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:18.700322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d8812460-3920-4dc3-b910-aacde0ed1326 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1299 microversion: 2.1 time: 0.149711 May 16 15:17:18.710703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 126/262] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:18 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:18.752498 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e80559e5-7689-412a-b72b-dcf70132e0e8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:18.753202 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e80559e5-7689-412a-b72b-dcf70132e0e8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:18.759572 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e80559e5-7689-412a-b72b-dcf70132e0e8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.760087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e80559e5-7689-412a-b72b-dcf70132e0e8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.760936 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e80559e5-7689-412a-b72b-dcf70132e0e8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.761376 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e80559e5-7689-412a-b72b-dcf70132e0e8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:19.110069 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e80559e5-7689-412a-b72b-dcf70132e0e8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:19.118663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e80559e5-7689-412a-b72b-dcf70132e0e8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.370392 May 16 15:17:19.132580 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 137/263] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:18 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:19.286437 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:19.287637 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:19.293705 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:19.294181 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:19.295135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:19.295575 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:19.616039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:19.623848 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:19.625341 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:19.626506 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-acf86d11-bd15-4f57-baa4-887b5c2e17eb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.344136 May 16 15:17:19.627913 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 127/264] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:19 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:19.718541 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-48328073-1fd7-4189-9f54-81fe6c0dd94d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:19.719182 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-48328073-1fd7-4189-9f54-81fe6c0dd94d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:19.726624 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48328073-1fd7-4189-9f54-81fe6c0dd94d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:19.727064 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48328073-1fd7-4189-9f54-81fe6c0dd94d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:19.727880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48328073-1fd7-4189-9f54-81fe6c0dd94d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:19.728310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48328073-1fd7-4189-9f54-81fe6c0dd94d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.064736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-48328073-1fd7-4189-9f54-81fe6c0dd94d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:20.073098 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-48328073-1fd7-4189-9f54-81fe6c0dd94d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.358418 May 16 15:17:20.073674 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 138/265] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:19 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:20.136369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5b62d276-d480-4d83-becb-cda79d892407 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:20.136976 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5b62d276-d480-4d83-becb-cda79d892407 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:20.144149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5b62d276-d480-4d83-becb-cda79d892407 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.144982 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5b62d276-d480-4d83-becb-cda79d892407 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.151822 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5b62d276-d480-4d83-becb-cda79d892407 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.152502 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5b62d276-d480-4d83-becb-cda79d892407 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.330770 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5b62d276-d480-4d83-becb-cda79d892407 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:20.338919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5b62d276-d480-4d83-becb-cda79d892407 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.206340 May 16 15:17:20.339469 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 128/266] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:20 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:20.645844 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:20.647748 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:20.654149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.654721 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.655607 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.656195 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.688532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-1893ca5e-a1b3-401b-b51f-5d59a9cc01c8 req-729c1625-7746-44a6-a0d0-7256817b0978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e20c89-9049-4b13-a531-2c2e361ed84d", "tag": "418db1a8-e530-4a38-a317-c50a19a4aed2"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:20.700485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1893ca5e-a1b3-401b-b51f-5d59a9cc01c8 req-729c1625-7746-44a6-a0d0-7256817b0978 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.701018 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1893ca5e-a1b3-401b-b51f-5d59a9cc01c8 req-729c1625-7746-44a6-a0d0-7256817b0978 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.714027 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-1893ca5e-a1b3-401b-b51f-5d59a9cc01c8 req-729c1625-7746-44a6-a0d0-7256817b0978 service nova] Creating event network-changed:418db1a8-e530-4a38-a317-c50a19a4aed2 for instance 71e20c89-9049-4b13-a531-2c2e361ed84d on hv-cinder-84175 May 16 15:17:20.719977 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-1893ca5e-a1b3-401b-b51f-5d59a9cc01c8 req-729c1625-7746-44a6-a0d0-7256817b0978 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035666 May 16 15:17:20.720666 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 129/267] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:17:20.810629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:20.819878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:20.821463 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:20.822655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-453b83c0-5a34-4caf-a7c5-394a8016c7ee tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.180835 May 16 15:17:20.823222 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 139/268] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:20 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:21.089991 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5fd21b8c-d723-4de7-ad0d-e69d2946bceb tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:21.090717 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5fd21b8c-d723-4de7-ad0d-e69d2946bceb tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:21.097023 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5fd21b8c-d723-4de7-ad0d-e69d2946bceb tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.097407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5fd21b8c-d723-4de7-ad0d-e69d2946bceb tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.098163 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5fd21b8c-d723-4de7-ad0d-e69d2946bceb tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.098589 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5fd21b8c-d723-4de7-ad0d-e69d2946bceb tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.225630 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5fd21b8c-d723-4de7-ad0d-e69d2946bceb tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:21.232756 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5fd21b8c-d723-4de7-ad0d-e69d2946bceb tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.146969 May 16 15:17:21.233305 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 130/269] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:21 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:21.356843 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2da3233b-12d3-44cc-ba43-fe288d17af1a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:21.357379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2da3233b-12d3-44cc-ba43-fe288d17af1a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:21.363105 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2da3233b-12d3-44cc-ba43-fe288d17af1a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.363561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2da3233b-12d3-44cc-ba43-fe288d17af1a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.364357 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2da3233b-12d3-44cc-ba43-fe288d17af1a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.364797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2da3233b-12d3-44cc-ba43-fe288d17af1a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.491316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2da3233b-12d3-44cc-ba43-fe288d17af1a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:21.498537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2da3233b-12d3-44cc-ba43-fe288d17af1a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.145576 May 16 15:17:21.499126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 140/270] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:21 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:21.840919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:21.841513 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:21.847794 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.848239 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.849000 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.849428 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.979284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:21.987312 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:21.988924 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:21.990087 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9276ea1f-6b98-4612-8a59-78f362744abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.153057 May 16 15:17:21.990647 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 131/271] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:21 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:22.249802 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-86ea755c-77ca-4c56-a0c7-57f0146a8aae tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:22.250418 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-86ea755c-77ca-4c56-a0c7-57f0146a8aae tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:22.257884 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86ea755c-77ca-4c56-a0c7-57f0146a8aae tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:22.258333 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86ea755c-77ca-4c56-a0c7-57f0146a8aae tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:22.259096 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86ea755c-77ca-4c56-a0c7-57f0146a8aae tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:22.259534 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86ea755c-77ca-4c56-a0c7-57f0146a8aae tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:22.385147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-86ea755c-77ca-4c56-a0c7-57f0146a8aae tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:22.392244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-86ea755c-77ca-4c56-a0c7-57f0146a8aae tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.146179 May 16 15:17:22.392803 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 141/272] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:22 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:22.514965 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-913379ae-27fc-42c6-81bf-c77f3e525d2e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:22.515532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-913379ae-27fc-42c6-81bf-c77f3e525d2e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:22.521876 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-913379ae-27fc-42c6-81bf-c77f3e525d2e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:22.522324 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-913379ae-27fc-42c6-81bf-c77f3e525d2e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:22.523086 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-913379ae-27fc-42c6-81bf-c77f3e525d2e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:22.523519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-913379ae-27fc-42c6-81bf-c77f3e525d2e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:22.650379 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-913379ae-27fc-42c6-81bf-c77f3e525d2e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:22.657562 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-913379ae-27fc-42c6-81bf-c77f3e525d2e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.146554 May 16 15:17:22.658124 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 132/273] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:22 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:23.007735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:23.008361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:23.014199 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:23.014646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:23.015401 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:23.015857 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:23.141548 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:23.150138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:23.151616 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:23.152782 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c9b629f7-9568-4f99-9396-4180e3dff132 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.149179 May 16 15:17:23.153334 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 142/274] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:23 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:23.409241 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6321265b-07de-4e01-826f-a203f6628717 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:23.409783 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6321265b-07de-4e01-826f-a203f6628717 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:23.416661 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6321265b-07de-4e01-826f-a203f6628717 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:23.417104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6321265b-07de-4e01-826f-a203f6628717 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:23.417863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6321265b-07de-4e01-826f-a203f6628717 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:23.418286 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6321265b-07de-4e01-826f-a203f6628717 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:23.548200 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6321265b-07de-4e01-826f-a203f6628717 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:23.555652 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6321265b-07de-4e01-826f-a203f6628717 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.150380 May 16 15:17:23.556272 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 133/275] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:23 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:23.674445 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3f55d1c2-66ef-4fed-8e24-0f6412a20452 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:23.675033 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3f55d1c2-66ef-4fed-8e24-0f6412a20452 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:23.681344 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f55d1c2-66ef-4fed-8e24-0f6412a20452 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:23.684022 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f55d1c2-66ef-4fed-8e24-0f6412a20452 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:23.684022 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f55d1c2-66ef-4fed-8e24-0f6412a20452 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:23.684022 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f55d1c2-66ef-4fed-8e24-0f6412a20452 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:23.810146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3f55d1c2-66ef-4fed-8e24-0f6412a20452 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:23.817287 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3f55d1c2-66ef-4fed-8e24-0f6412a20452 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.146778 May 16 15:17:23.817845 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 143/276] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:23 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:24.171250 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:24.171870 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:24.178055 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.178499 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.179842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.180275 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.314023 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:24.322207 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:24.323720 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:24.324885 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-95d07b48-8879-473f-9595-02f116a78f5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.157466 May 16 15:17:24.325655 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 134/277] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:24 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:24.572494 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-bc4bd9b1-3314-42bc-b451-31765c37c1c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:24.573136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-bc4bd9b1-3314-42bc-b451-31765c37c1c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:24.579077 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc4bd9b1-3314-42bc-b451-31765c37c1c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.579523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc4bd9b1-3314-42bc-b451-31765c37c1c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.580342 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc4bd9b1-3314-42bc-b451-31765c37c1c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.580992 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc4bd9b1-3314-42bc-b451-31765c37c1c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.743420 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-bc4bd9b1-3314-42bc-b451-31765c37c1c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:24.751107 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-bc4bd9b1-3314-42bc-b451-31765c37c1c0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.183266 May 16 15:17:24.751886 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 144/278] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:24 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:24.834059 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-78df6a41-196a-478a-a0b9-b3a5ab3b941e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:24.843305 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-78df6a41-196a-478a-a0b9-b3a5ab3b941e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:24.847461 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78df6a41-196a-478a-a0b9-b3a5ab3b941e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.848591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78df6a41-196a-478a-a0b9-b3a5ab3b941e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.849682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78df6a41-196a-478a-a0b9-b3a5ab3b941e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.850569 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78df6a41-196a-478a-a0b9-b3a5ab3b941e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:25.057690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-78df6a41-196a-478a-a0b9-b3a5ab3b941e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:25.065919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-78df6a41-196a-478a-a0b9-b3a5ab3b941e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.235718 May 16 15:17:25.066481 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 135/279] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:24 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:25.342367 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:25.342890 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:25.348807 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:25.349290 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:25.350046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:25.350476 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:25.475281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:25.484846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:25.486358 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:25.487537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-547170b1-d2a0-45cd-b65d-3fe09c0293cd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1744 microversion: 2.20 time: 0.149197 May 16 15:17:25.488116 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 145/280] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:25 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:25.769336 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-78408b60-6129-4e35-b2fe-33a29142e8ad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:25.769940 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-78408b60-6129-4e35-b2fe-33a29142e8ad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:25.776736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78408b60-6129-4e35-b2fe-33a29142e8ad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:25.777175 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78408b60-6129-4e35-b2fe-33a29142e8ad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:25.777933 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78408b60-6129-4e35-b2fe-33a29142e8ad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:25.778359 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78408b60-6129-4e35-b2fe-33a29142e8ad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:25.914375 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-78408b60-6129-4e35-b2fe-33a29142e8ad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:25.921869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-78408b60-6129-4e35-b2fe-33a29142e8ad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.156195 May 16 15:17:25.922422 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 136/281] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:25 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:26.083161 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d5821a81-e679-43a1-b855-439071015071 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:26.083707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d5821a81-e679-43a1-b855-439071015071 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:26.090216 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d5821a81-e679-43a1-b855-439071015071 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:26.092779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d5821a81-e679-43a1-b855-439071015071 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:26.092779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d5821a81-e679-43a1-b855-439071015071 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:26.092779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d5821a81-e679-43a1-b855-439071015071 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:26.219811 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d5821a81-e679-43a1-b855-439071015071 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:26.227053 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d5821a81-e679-43a1-b855-439071015071 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.147854 May 16 15:17:26.227658 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 146/282] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:26 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:26.505320 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:26.505958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:26.512442 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:26.512894 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:26.513660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:26.514094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:26.644111 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:26.652171 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:26.653744 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:26.654895 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-036f35b6-0c33-4a3a-a401-169b53987461 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1744 microversion: 2.20 time: 0.153466 May 16 15:17:26.657150 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 137/283] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:26 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:26.938319 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7f181a24-02a8-4b2f-aa59-7b1560b3fda0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:26.938931 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7f181a24-02a8-4b2f-aa59-7b1560b3fda0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:26.944990 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7f181a24-02a8-4b2f-aa59-7b1560b3fda0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:26.945441 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7f181a24-02a8-4b2f-aa59-7b1560b3fda0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:26.946778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7f181a24-02a8-4b2f-aa59-7b1560b3fda0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:26.947217 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7f181a24-02a8-4b2f-aa59-7b1560b3fda0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.072693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7f181a24-02a8-4b2f-aa59-7b1560b3fda0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:27.080053 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7f181a24-02a8-4b2f-aa59-7b1560b3fda0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.145550 May 16 15:17:27.080692 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 147/284] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:26 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:27.243201 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6a7bff54-f3ff-4359-aa00-92e9fa95b8c1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:27.243945 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6a7bff54-f3ff-4359-aa00-92e9fa95b8c1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:27.249905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6a7bff54-f3ff-4359-aa00-92e9fa95b8c1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.250391 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6a7bff54-f3ff-4359-aa00-92e9fa95b8c1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.251183 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6a7bff54-f3ff-4359-aa00-92e9fa95b8c1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.251638 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6a7bff54-f3ff-4359-aa00-92e9fa95b8c1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.387188 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6a7bff54-f3ff-4359-aa00-92e9fa95b8c1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:27.394515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6a7bff54-f3ff-4359-aa00-92e9fa95b8c1 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.155239 May 16 15:17:27.395082 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 138/285] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:27 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:27.672493 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:27.673114 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:27.679468 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.679965 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.681482 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.681930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.814603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:27.822515 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:27.824020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:27.825180 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-988a81aa-4e13-49e5-8921-b2b27be9879f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1744 microversion: 2.20 time: 0.156595 May 16 15:17:27.825738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 148/286] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:27 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:28.097819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-32ede34d-95a4-433e-8218-6a08d8abce0e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:28.098425 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-32ede34d-95a4-433e-8218-6a08d8abce0e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:28.105295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-32ede34d-95a4-433e-8218-6a08d8abce0e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.105745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-32ede34d-95a4-433e-8218-6a08d8abce0e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.106511 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-32ede34d-95a4-433e-8218-6a08d8abce0e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.106941 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-32ede34d-95a4-433e-8218-6a08d8abce0e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.231673 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-32ede34d-95a4-433e-8218-6a08d8abce0e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:28.239050 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-32ede34d-95a4-433e-8218-6a08d8abce0e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.145418 May 16 15:17:28.239621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 139/287] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:28 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:28.412457 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8ee39118-56c7-4212-adf4-54c6f6b5559e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:28.413410 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8ee39118-56c7-4212-adf4-54c6f6b5559e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:28.421202 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8ee39118-56c7-4212-adf4-54c6f6b5559e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.421444 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8ee39118-56c7-4212-adf4-54c6f6b5559e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.422238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8ee39118-56c7-4212-adf4-54c6f6b5559e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.422676 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8ee39118-56c7-4212-adf4-54c6f6b5559e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.564818 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8ee39118-56c7-4212-adf4-54c6f6b5559e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:28.572143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8ee39118-56c7-4212-adf4-54c6f6b5559e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.163919 May 16 15:17:28.572714 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 149/288] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:28 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:28.843257 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:28.844094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:28.851049 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.851697 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.852551 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.853047 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.993938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:29.003169 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:29.004890 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:29.006307 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-93b99f56-91f5-4e92-b66a-baae5c9875a6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.167514 May 16 15:17:29.007392 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 140/289] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:28 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:29.256718 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7b59d1c9-25dc-43b8-8c08-4e1a551c7ed1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:29.257523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7b59d1c9-25dc-43b8-8c08-4e1a551c7ed1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:29.264850 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b59d1c9-25dc-43b8-8c08-4e1a551c7ed1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.265490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b59d1c9-25dc-43b8-8c08-4e1a551c7ed1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.266800 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b59d1c9-25dc-43b8-8c08-4e1a551c7ed1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.267527 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b59d1c9-25dc-43b8-8c08-4e1a551c7ed1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.441680 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7b59d1c9-25dc-43b8-8c08-4e1a551c7ed1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:29.453475 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7b59d1c9-25dc-43b8-8c08-4e1a551c7ed1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.200694 May 16 15:17:29.463454 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 150/290] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:29 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:29.591030 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-cd3df065-2e2a-4990-86c6-b231fa2db7d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:29.591694 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cd3df065-2e2a-4990-86c6-b231fa2db7d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:29.601381 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cd3df065-2e2a-4990-86c6-b231fa2db7d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.601824 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cd3df065-2e2a-4990-86c6-b231fa2db7d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.602864 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cd3df065-2e2a-4990-86c6-b231fa2db7d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.603467 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cd3df065-2e2a-4990-86c6-b231fa2db7d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.801953 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-cd3df065-2e2a-4990-86c6-b231fa2db7d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:29.814820 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-cd3df065-2e2a-4990-86c6-b231fa2db7d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.228904 May 16 15:17:29.816426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 141/291] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:29 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:29.931097 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-7f4b4180-61c5-4be6-b5b0-9f1bd2916d5c req-9d59adce-268a-403d-bbf4-295bafe2dacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d612141-6fe0-4d49-b1aa-071acc497104", "name": "network-vif-plugged", "status": "completed", "tag": "75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:29.942184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-7f4b4180-61c5-4be6-b5b0-9f1bd2916d5c req-9d59adce-268a-403d-bbf4-295bafe2dacd service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.942706 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-7f4b4180-61c5-4be6-b5b0-9f1bd2916d5c req-9d59adce-268a-403d-bbf4-295bafe2dacd service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.956058 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-7f4b4180-61c5-4be6-b5b0-9f1bd2916d5c req-9d59adce-268a-403d-bbf4-295bafe2dacd service nova] Creating event network-vif-plugged:75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b for instance 4d612141-6fe0-4d49-b1aa-071acc497104 on hv-cinder-84175 May 16 15:17:29.962095 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-7f4b4180-61c5-4be6-b5b0-9f1bd2916d5c req-9d59adce-268a-403d-bbf4-295bafe2dacd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039528 May 16 15:17:29.962886 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 151/292] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:30.027266 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:30.028148 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:30.035935 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.036577 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.037510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.038112 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.218800 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:30.231326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:30.233256 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:30.234774 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b99d8b22-e187-4683-acc1-9db50b58f4cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.212472 May 16 15:17:30.235486 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 142/293] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:30 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:30.471065 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e9781596-15d1-4748-9fef-64266ceb32f1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:30.472115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e9781596-15d1-4748-9fef-64266ceb32f1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:30.485653 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e9781596-15d1-4748-9fef-64266ceb32f1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.486161 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e9781596-15d1-4748-9fef-64266ceb32f1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.486989 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e9781596-15d1-4748-9fef-64266ceb32f1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.487423 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e9781596-15d1-4748-9fef-64266ceb32f1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.730982 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e9781596-15d1-4748-9fef-64266ceb32f1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:30.738566 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e9781596-15d1-4748-9fef-64266ceb32f1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.271938 May 16 15:17:30.741363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 152/294] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:30 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:30.834829 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a4814aae-2b2f-4b86-9a41-30998ffc6a46 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:30.835701 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a4814aae-2b2f-4b86-9a41-30998ffc6a46 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:30.842339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4814aae-2b2f-4b86-9a41-30998ffc6a46 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.843212 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4814aae-2b2f-4b86-9a41-30998ffc6a46 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.844352 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4814aae-2b2f-4b86-9a41-30998ffc6a46 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.845173 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4814aae-2b2f-4b86-9a41-30998ffc6a46 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.002663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a4814aae-2b2f-4b86-9a41-30998ffc6a46 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:31.011171 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a4814aae-2b2f-4b86-9a41-30998ffc6a46 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.180529 May 16 15:17:31.012156 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 143/295] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:30 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:31.256361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:31.257047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:31.263782 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.264237 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.265020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.265641 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.412384 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:31.420816 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:31.422287 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:31.423667 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f68ab4e5-bac3-4e4b-a6e0-87a4ca7e89a8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.173062 May 16 15:17:31.424376 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 153/296] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:31 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:31.758638 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-05d2c1d9-d558-4ccd-92c7-a0734709bda3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:31.759326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-05d2c1d9-d558-4ccd-92c7-a0734709bda3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:31.766331 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-05d2c1d9-d558-4ccd-92c7-a0734709bda3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.767074 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-05d2c1d9-d558-4ccd-92c7-a0734709bda3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.768153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-05d2c1d9-d558-4ccd-92c7-a0734709bda3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.770766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-05d2c1d9-d558-4ccd-92c7-a0734709bda3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.984156 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-05d2c1d9-d558-4ccd-92c7-a0734709bda3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:31.986099 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-069cfb4c-9b2b-4f0c-afe1-2618d017ef0f req-9a9b75ce-48c2-49bb-b5ea-6dd2eb549ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893feede-4052-4c51-96a2-1f93510d1f5f", "name": "network-vif-plugged", "status": "completed", "tag": "7be8453f-3109-4b92-981a-837b09373d42"}, {"server_uuid": "71e20c89-9049-4b13-a531-2c2e361ed84d", "name": "network-vif-plugged", "status": "completed", "tag": "418db1a8-e530-4a38-a317-c50a19a4aed2"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:31.994575 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-05d2c1d9-d558-4ccd-92c7-a0734709bda3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.239738 May 16 15:17:32.002079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-069cfb4c-9b2b-4f0c-afe1-2618d017ef0f req-9a9b75ce-48c2-49bb-b5ea-6dd2eb549ab5 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.002906 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-069cfb4c-9b2b-4f0c-afe1-2618d017ef0f req-9a9b75ce-48c2-49bb-b5ea-6dd2eb549ab5 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.005447 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 144/297] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:31 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:32.031249 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-069cfb4c-9b2b-4f0c-afe1-2618d017ef0f req-9a9b75ce-48c2-49bb-b5ea-6dd2eb549ab5 service nova] Creating event network-vif-plugged:7be8453f-3109-4b92-981a-837b09373d42 for instance 893feede-4052-4c51-96a2-1f93510d1f5f on hv-cinder-84175 May 16 15:17:32.031947 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-069cfb4c-9b2b-4f0c-afe1-2618d017ef0f req-9a9b75ce-48c2-49bb-b5ea-6dd2eb549ab5 service nova] Creating event network-vif-plugged:418db1a8-e530-4a38-a317-c50a19a4aed2 for instance 71e20c89-9049-4b13-a531-2c2e361ed84d on hv-cinder-84175 May 16 15:17:32.041635 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-069cfb4c-9b2b-4f0c-afe1-2618d017ef0f req-9a9b75ce-48c2-49bb-b5ea-6dd2eb549ab5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065807 May 16 15:17:32.042403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 154/298] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:32.043236 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7fac0303-90fd-4081-8915-e0fa077dace3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:32.044458 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7fac0303-90fd-4081-8915-e0fa077dace3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:32.050981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7fac0303-90fd-4081-8915-e0fa077dace3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.051439 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7fac0303-90fd-4081-8915-e0fa077dace3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.052315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7fac0303-90fd-4081-8915-e0fa077dace3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.052762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7fac0303-90fd-4081-8915-e0fa077dace3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.209901 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7fac0303-90fd-4081-8915-e0fa077dace3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:32.218339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7fac0303-90fd-4081-8915-e0fa077dace3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1369 microversion: 2.1 time: 0.180170 May 16 15:17:32.218899 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 145/299] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:32 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:32.442803 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:32.443442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:32.450183 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.450633 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.451400 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.451969 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.601559 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:32.609984 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:32.611482 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:32.612669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8c682a78-ce0f-4935-bcbf-17c2e82a5df1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.174231 May 16 15:17:32.613484 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 155/300] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:32 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:33.014033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-90fff42f-bed4-4471-bf73-feeda2596382 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:33.014899 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-90fff42f-bed4-4471-bf73-feeda2596382 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:33.023685 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-90fff42f-bed4-4471-bf73-feeda2596382 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.029208 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-90fff42f-bed4-4471-bf73-feeda2596382 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.029208 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-90fff42f-bed4-4471-bf73-feeda2596382 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.029208 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-90fff42f-bed4-4471-bf73-feeda2596382 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.232281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-90fff42f-bed4-4471-bf73-feeda2596382 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:33.237098 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-779c9960-9f09-4519-bd7d-1e8643ac944d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:33.238056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-779c9960-9f09-4519-bd7d-1e8643ac944d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:33.240578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-90fff42f-bed4-4471-bf73-feeda2596382 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.232249 May 16 15:17:33.250545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 146/301] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:33 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:33.255588 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-779c9960-9f09-4519-bd7d-1e8643ac944d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.256334 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-779c9960-9f09-4519-bd7d-1e8643ac944d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.257955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-779c9960-9f09-4519-bd7d-1e8643ac944d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.259436 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-779c9960-9f09-4519-bd7d-1e8643ac944d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.418271 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-779c9960-9f09-4519-bd7d-1e8643ac944d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:33.429229 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-779c9960-9f09-4519-bd7d-1e8643ac944d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1564 microversion: 2.1 time: 0.196030 May 16 15:17:33.433567 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 156/302] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:33 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1564 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:33.450373 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-76f13ff9-e32e-49f7-bb8e-fc534c1f57f6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:33.451168 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-76f13ff9-e32e-49f7-bb8e-fc534c1f57f6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:33.458178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-76f13ff9-e32e-49f7-bb8e-fc534c1f57f6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.458632 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-76f13ff9-e32e-49f7-bb8e-fc534c1f57f6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.459398 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-76f13ff9-e32e-49f7-bb8e-fc534c1f57f6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.459871 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-76f13ff9-e32e-49f7-bb8e-fc534c1f57f6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.562051 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-76f13ff9-e32e-49f7-bb8e-fc534c1f57f6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116932 May 16 15:17:33.563049 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 147/303] 10.222.0.71 () {58 vars in 1274 bytes} [Mon May 16 15:17:33 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:33.631309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:33.632537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:33.639954 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.640404 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.641196 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.641625 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.935358 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:33.949389 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:33.953401 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:33.954690 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2a920790-db67-44f5-a3ee-cfde294b760a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.328017 May 16 15:17:33.955542 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 157/304] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:33 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:34.259258 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1c3a2f8d-44e2-41b3-9e7f-3ce66eaaffda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:34.259890 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1c3a2f8d-44e2-41b3-9e7f-3ce66eaaffda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:34.266322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1c3a2f8d-44e2-41b3-9e7f-3ce66eaaffda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:34.266765 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1c3a2f8d-44e2-41b3-9e7f-3ce66eaaffda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:34.267534 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1c3a2f8d-44e2-41b3-9e7f-3ce66eaaffda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:34.268056 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1c3a2f8d-44e2-41b3-9e7f-3ce66eaaffda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:34.536516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1c3a2f8d-44e2-41b3-9e7f-3ce66eaaffda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:34.544081 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1c3a2f8d-44e2-41b3-9e7f-3ce66eaaffda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1366 microversion: 2.1 time: 0.289666 May 16 15:17:34.544833 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 148/305] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:34 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:34.973504 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:34.974956 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:34.982665 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:34.983513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:34.984710 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:34.985357 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.248207 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-74c96d11-2c7a-4a6c-9468-8f25cf785f3b req-b79f3d56-f0db-4543-ba2a-8954302c000a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d612141-6fe0-4d49-b1aa-071acc497104", "tag": "75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:35.263236 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-74c96d11-2c7a-4a6c-9468-8f25cf785f3b req-b79f3d56-f0db-4543-ba2a-8954302c000a service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.264560 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-74c96d11-2c7a-4a6c-9468-8f25cf785f3b req-b79f3d56-f0db-4543-ba2a-8954302c000a service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.288736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-74c96d11-2c7a-4a6c-9468-8f25cf785f3b req-b79f3d56-f0db-4543-ba2a-8954302c000a service nova] Creating event network-changed:75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b for instance 4d612141-6fe0-4d49-b1aa-071acc497104 on hv-cinder-84175 May 16 15:17:35.301886 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-74c96d11-2c7a-4a6c-9468-8f25cf785f3b req-b79f3d56-f0db-4543-ba2a-8954302c000a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057338 May 16 15:17:35.302795 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 149/306] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:17:35.313221 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:35.324914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:35.326623 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:35.328132 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1cf0060d-ad7f-4738-8cc3-adeaa28098b3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.358627 May 16 15:17:35.329307 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 158/307] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:34 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:35.563093 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-63157e8f-e03b-4f2a-a482-1f1ee8ee9cf0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:35.563944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-63157e8f-e03b-4f2a-a482-1f1ee8ee9cf0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:35.573211 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63157e8f-e03b-4f2a-a482-1f1ee8ee9cf0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.577521 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63157e8f-e03b-4f2a-a482-1f1ee8ee9cf0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.577521 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63157e8f-e03b-4f2a-a482-1f1ee8ee9cf0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.577521 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63157e8f-e03b-4f2a-a482-1f1ee8ee9cf0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.854261 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-63157e8f-e03b-4f2a-a482-1f1ee8ee9cf0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:35.862654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-63157e8f-e03b-4f2a-a482-1f1ee8ee9cf0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1556 microversion: 2.1 time: 0.304647 May 16 15:17:35.863331 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 150/308] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:35 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1556 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:35.879032 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6a35ad12-3445-4e10-8292-78e9e78d940d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:35.879537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6a35ad12-3445-4e10-8292-78e9e78d940d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:35.886874 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6a35ad12-3445-4e10-8292-78e9e78d940d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.887326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6a35ad12-3445-4e10-8292-78e9e78d940d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.888124 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6a35ad12-3445-4e10-8292-78e9e78d940d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.888560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6a35ad12-3445-4e10-8292-78e9e78d940d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.067930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6a35ad12-3445-4e10-8292-78e9e78d940d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186236 May 16 15:17:36.067930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 159/309] 10.222.0.71 () {58 vars in 1274 bytes} [Mon May 16 15:17:35 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:36.346715 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:36.347315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:36.360038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.360971 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.362532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.363170 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.577919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:36.592075 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:36.593657 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:36.595111 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-64ae050f-f76d-40bb-8794-3cfb2cd91876 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.251885 May 16 15:17:36.596185 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 151/310] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:36 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:37.398490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-6c7a9652-97b0-43d7-a736-9fc60c0bd4e0 req-f0843463-b8d3-42c4-9682-94f2d818d4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e20c89-9049-4b13-a531-2c2e361ed84d", "tag": "418db1a8-e530-4a38-a317-c50a19a4aed2"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:37.409587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-6c7a9652-97b0-43d7-a736-9fc60c0bd4e0 req-f0843463-b8d3-42c4-9682-94f2d818d4ec service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.410331 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-6c7a9652-97b0-43d7-a736-9fc60c0bd4e0 req-f0843463-b8d3-42c4-9682-94f2d818d4ec service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.423779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-6c7a9652-97b0-43d7-a736-9fc60c0bd4e0 req-f0843463-b8d3-42c4-9682-94f2d818d4ec service nova] Creating event network-changed:418db1a8-e530-4a38-a317-c50a19a4aed2 for instance 71e20c89-9049-4b13-a531-2c2e361ed84d on hv-cinder-84175 May 16 15:17:37.429677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-6c7a9652-97b0-43d7-a736-9fc60c0bd4e0 req-f0843463-b8d3-42c4-9682-94f2d818d4ec service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035634 May 16 15:17:37.430714 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 160/311] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:37.617194 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:37.619937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:37.629884 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.630615 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.631572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.632335 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.874102 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:37.886127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:37.891155 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:37.892431 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4c64d74c-49df-4a93-81f5-6c44847a8d4b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.282441 May 16 15:17:37.893570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 152/312] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:37 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:38.911704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:38.912491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:38.920201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.920649 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.921430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.921866 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.088457 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:39.096782 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:39.098281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:39.099464 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dde38734-ec3f-4ce5-b75a-cdcb32cd4a7c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.192422 May 16 15:17:39.100061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 161/313] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:38 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:40.119038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:40.119605 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:40.126332 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:40.126782 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:40.127570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:40.128043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:40.269837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:40.278670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:40.280452 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:40.281614 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6f0ea639-3c29-4e51-aa7b-cce27a285ac8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.167148 May 16 15:17:40.282170 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 153/314] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:40 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:41.300378 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:41.301024 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:41.307272 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:41.307751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.308514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:41.308946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.440119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:41.449087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:41.454048 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:41.454048 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a95c2bc2-c2ad-40a3-9ef4-037d46b02484 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1739 microversion: 2.20 time: 0.155196 May 16 15:17:41.454048 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 162/315] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:41 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:41.662273 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8e220e01-9720-443b-b565-19af7e68f220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:41.662779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8e220e01-9720-443b-b565-19af7e68f220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:41.669073 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8e220e01-9720-443b-b565-19af7e68f220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:41.669524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8e220e01-9720-443b-b565-19af7e68f220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.670289 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8e220e01-9720-443b-b565-19af7e68f220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:41.670730 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8e220e01-9720-443b-b565-19af7e68f220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.693232 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8e220e01-9720-443b-b565-19af7e68f220 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/ips" status: 200 len: 146 microversion: 2.1 time: 0.034792 May 16 15:17:41.693782 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 154/316] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:17:41 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:42.470365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:42.470982 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:42.477305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.477747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.478512 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.478948 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.603851 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:42.611945 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:42.613437 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:42.614593 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-137563d6-32b8-4ffb-8a93-90002aa488af tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1721 microversion: 2.20 time: 0.148210 May 16 15:17:42.615172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 163/317] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:42 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:43.632546 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:43.633688 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:43.640051 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:43.640495 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:43.641254 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:43.641683 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:43.693890 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-67ba447f-33a8-46b6-8b26-c4a9b57ae463 req-bf1a25d3-4be3-47e7-b3f4-26d5a14da0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893feede-4052-4c51-96a2-1f93510d1f5f", "name": "network-vif-unplugged", "status": "completed", "tag": "7be8453f-3109-4b92-981a-837b09373d42"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:43.710108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-67ba447f-33a8-46b6-8b26-c4a9b57ae463 req-bf1a25d3-4be3-47e7-b3f4-26d5a14da0fc service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:43.710558 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-67ba447f-33a8-46b6-8b26-c4a9b57ae463 req-bf1a25d3-4be3-47e7-b3f4-26d5a14da0fc service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:43.722841 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-67ba447f-33a8-46b6-8b26-c4a9b57ae463 req-bf1a25d3-4be3-47e7-b3f4-26d5a14da0fc service nova] Creating event network-vif-unplugged:7be8453f-3109-4b92-981a-837b09373d42 for instance 893feede-4052-4c51-96a2-1f93510d1f5f on hv-cinder-84175 May 16 15:17:43.728770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-67ba447f-33a8-46b6-8b26-c4a9b57ae463 req-bf1a25d3-4be3-47e7-b3f4-26d5a14da0fc service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038784 May 16 15:17:43.729550 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 164/318] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:43.779266 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:43.787734 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:43.789894 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:43.791144 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d3e0eeac-0546-4779-816f-31fff4696013 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1721 microversion: 2.20 time: 0.162349 May 16 15:17:43.791955 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 155/319] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:43 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:44.811722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:44.812413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:44.818900 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:44.819350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:44.820155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:44.821120 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:44.964878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:44.977018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:44.978882 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:44.980067 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-60b83219-6a8d-43a5-ab4a-38d4deaec01d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1724 microversion: 2.20 time: 0.173355 May 16 15:17:44.980629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 165/320] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:44 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:45.002874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-66421dc0-a69c-4463-8030-60c3b4514427 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e538de2-13c4-488f-953a-8383f102b83f"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:45.004561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-66421dc0-a69c-4463-8030-60c3b4514427 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:45.014733 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-66421dc0-a69c-4463-8030-60c3b4514427 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.015195 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-66421dc0-a69c-4463-8030-60c3b4514427 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.016011 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-66421dc0-a69c-4463-8030-60c3b4514427 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.016443 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-66421dc0-a69c-4463-8030-60c3b4514427 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.430343 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b66d1e9b-8472-418f-98fa-d4f5f673089a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db4a85aa-8a74-4651-87c8-4ee202d2e4af"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:45.431433 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b66d1e9b-8472-418f-98fa-d4f5f673089a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:45.437386 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b66d1e9b-8472-418f-98fa-d4f5f673089a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.437843 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b66d1e9b-8472-418f-98fa-d4f5f673089a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.438603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b66d1e9b-8472-418f-98fa-d4f5f673089a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.439187 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b66d1e9b-8472-418f-98fa-d4f5f673089a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.988054 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-66421dc0-a69c-4463-8030-60c3b4514427 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.989824 May 16 15:17:45.988662 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 156/321] 10.222.0.71 () {62 vars in 1363 bytes} [Mon May 16 15:17:44 2022] POST /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments => generated 188 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:17:46.107554 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5520c626-c5cd-458a-9d0c-586cbb05796e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:46.108157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5520c626-c5cd-458a-9d0c-586cbb05796e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:46.115089 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5520c626-c5cd-458a-9d0c-586cbb05796e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:46.116240 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5520c626-c5cd-458a-9d0c-586cbb05796e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:46.116353 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5520c626-c5cd-458a-9d0c-586cbb05796e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:46.116804 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5520c626-c5cd-458a-9d0c-586cbb05796e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:46.140709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b66d1e9b-8472-418f-98fa-d4f5f673089a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714722 May 16 15:17:46.141588 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 166/322] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:17:45 2022] POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:17:46.356603 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5520c626-c5cd-458a-9d0c-586cbb05796e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/action" status: 202 len: 0 microversion: 2.20 time: 0.252883 May 16 15:17:46.357267 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 157/323] 10.222.0.71 () {62 vars in 1318 bytes} [Mon May 16 15:17:46 2022] POST /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 15:17:46.366322 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:46.367127 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:46.374599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:46.375053 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:46.376271 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:46.376271 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:46.510864 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:46.519365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:46.520868 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:46.522282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-43b848d0-19bd-4424-bcfd-95b3b6fe5907 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1750 microversion: 2.20 time: 0.160688 May 16 15:17:46.522834 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 167/324] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:46 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:47.541909 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:47.542461 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:47.549448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:47.549899 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:47.550670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:47.551109 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:47.688299 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:47.698173 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:47.700298 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:47.701479 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a4cd7606-2d91-4f35-bf42-2404a17a9a0c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1750 microversion: 2.20 time: 0.163670 May 16 15:17:47.702040 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 158/325] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:47 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:48.725605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:48.726213 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:48.732727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:48.733168 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:48.733921 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:48.734348 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:48.860448 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:48.869093 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:48.870585 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:48.871854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-27c43917-718d-4442-abaf-b9a25fcc7d8f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1752 microversion: 2.20 time: 0.150002 May 16 15:17:48.872408 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 168/326] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:48 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:49.890210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:49.890818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:49.897359 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:49.897800 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:49.899059 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:49.899497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:50.024417 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:50.032453 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:50.033917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:50.035056 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6104dc9d-a873-426d-b81a-0e71b5242820 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1752 microversion: 2.20 time: 0.148719 May 16 15:17:50.035597 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 159/327] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:49 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:51.053569 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:51.054265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:51.061453 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.061895 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.062651 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.063081 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.190156 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:51.199005 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:51.200544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:51.201695 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-65f36c07-97fd-4272-b38f-680093473efa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1752 microversion: 2.20 time: 0.152009 May 16 15:17:51.202259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 169/328] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:51 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:52.219303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:52.219934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:52.226214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.226649 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.227400 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.227859 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.352919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:52.361245 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:52.362726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:52.363906 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f9b2713b-071b-4a55-a33b-605767f47203 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1752 microversion: 2.20 time: 0.148417 May 16 15:17:52.364466 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 160/329] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:52 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:53.381529 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:53.382170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:53.388926 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:53.389374 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:53.390128 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:53.390562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:53.517517 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:53.525947 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:53.527425 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:53.528601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d49e56b8-9c3b-4894-9065-d15e64a7c1ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1752 microversion: 2.20 time: 0.150935 May 16 15:17:53.529148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 170/330] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:53 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:54.546790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:54.547399 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:54.553585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.554024 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.554775 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.555248 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.678013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cd545662-5525-4d40-83e8-4735d01819c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:54.684787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cd545662-5525-4d40-83e8-4735d01819c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.691013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cd545662-5525-4d40-83e8-4735d01819c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.701315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:54.710020 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:54.711646 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:54.712928 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-10d99dcd-b377-40ca-9516-e0e5f847282b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1752 microversion: 2.20 time: 0.170172 May 16 15:17:54.713694 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 161/331] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:54 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:54.748552 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cd545662-5525-4d40-83e8-4735d01819c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Going to try to stop instance {{(pid=117676) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 15:17:54.960444 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cd545662-5525-4d40-83e8-4735d01819c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/action" status: 202 len: 0 microversion: 2.1 time: 0.287109 May 16 15:17:54.961052 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 171/332] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:17:54 2022] POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:17:54.968994 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e5c7ae30-c8fe-4590-abaf-f3a1ae9230ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:54.969863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e5c7ae30-c8fe-4590-abaf-f3a1ae9230ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:54.975957 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5c7ae30-c8fe-4590-abaf-f3a1ae9230ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.976404 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5c7ae30-c8fe-4590-abaf-f3a1ae9230ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.977172 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5c7ae30-c8fe-4590-abaf-f3a1ae9230ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.977598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5c7ae30-c8fe-4590-abaf-f3a1ae9230ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.105408 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e5c7ae30-c8fe-4590-abaf-f3a1ae9230ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:55.113369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e5c7ae30-c8fe-4590-abaf-f3a1ae9230ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.148093 May 16 15:17:55.113944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 162/333] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:54 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:55.733746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:55.734429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:55.740558 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.741004 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.741757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.742188 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.929011 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:55.938038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:55.939510 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:55.940715 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-97653441-c60a-402a-961f-9bbb13b99781 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.212303 May 16 15:17:55.941265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 172/334] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:55 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:56.130124 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3009b278-60ab-4df1-acc3-17c925fde704 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:56.130741 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3009b278-60ab-4df1-acc3-17c925fde704 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:56.137889 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3009b278-60ab-4df1-acc3-17c925fde704 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.138341 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3009b278-60ab-4df1-acc3-17c925fde704 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.139114 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3009b278-60ab-4df1-acc3-17c925fde704 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.139550 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3009b278-60ab-4df1-acc3-17c925fde704 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.324237 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3009b278-60ab-4df1-acc3-17c925fde704 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:56.332282 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3009b278-60ab-4df1-acc3-17c925fde704 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.205850 May 16 15:17:56.332778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 163/335] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:56 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:56.959683 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:56.960320 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:56.967166 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.967613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.968410 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.968840 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:57.096347 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:57.105240 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:57.106752 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:57.107950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-86455072-1596-4c13-beea-742bb8599f78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.152476 May 16 15:17:57.108514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 173/336] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:56 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:57.350285 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-12b15dae-58d8-422f-88b4-6b9f96c9272a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:57.350908 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-12b15dae-58d8-422f-88b4-6b9f96c9272a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:57.357972 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12b15dae-58d8-422f-88b4-6b9f96c9272a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:57.358747 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12b15dae-58d8-422f-88b4-6b9f96c9272a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:57.359798 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12b15dae-58d8-422f-88b4-6b9f96c9272a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:57.360437 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12b15dae-58d8-422f-88b4-6b9f96c9272a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:57.504539 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-12b15dae-58d8-422f-88b4-6b9f96c9272a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:57.514013 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-12b15dae-58d8-422f-88b4-6b9f96c9272a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.167368 May 16 15:17:57.514604 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 164/337] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:57 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:58.126721 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:58.127357 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:58.134138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.134612 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.135385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.135948 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.278138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:58.286846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:58.288509 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:58.289691 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8aa04896-8d4a-4a61-95d7-272b360c40fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.166971 May 16 15:17:58.290356 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 174/338] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:58 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:58.532405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8740ca20-db15-4fb8-b6d8-5f7a1766fe9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:58.533017 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8740ca20-db15-4fb8-b6d8-5f7a1766fe9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:58.539221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8740ca20-db15-4fb8-b6d8-5f7a1766fe9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.540007 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8740ca20-db15-4fb8-b6d8-5f7a1766fe9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.540789 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8740ca20-db15-4fb8-b6d8-5f7a1766fe9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.541227 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8740ca20-db15-4fb8-b6d8-5f7a1766fe9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.680772 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-8740ca20-db15-4fb8-b6d8-5f7a1766fe9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:58.689638 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8740ca20-db15-4fb8-b6d8-5f7a1766fe9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.161059 May 16 15:17:58.690501 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 165/339] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:58 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:59.308735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:59.309379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:59.315761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.316312 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.317082 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.317518 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.463623 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:59.478021 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:59.481632 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:59.502648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4c8fd12f-983e-401b-a25c-befbd0ae8b42 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.178550 May 16 15:17:59.502648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 175/340] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:17:59 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:17:59.706839 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-994f4dc4-fdd2-4627-aa67-dc5c82c34210 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:59.707485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-994f4dc4-fdd2-4627-aa67-dc5c82c34210 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:59.714493 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-994f4dc4-fdd2-4627-aa67-dc5c82c34210 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.715024 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-994f4dc4-fdd2-4627-aa67-dc5c82c34210 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.715840 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-994f4dc4-fdd2-4627-aa67-dc5c82c34210 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.716553 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-994f4dc4-fdd2-4627-aa67-dc5c82c34210 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.875506 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-994f4dc4-fdd2-4627-aa67-dc5c82c34210 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:59.883726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-994f4dc4-fdd2-4627-aa67-dc5c82c34210 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.180579 May 16 15:17:59.884390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 166/341] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:17:59 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:00.505044 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:00.505634 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:00.512281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.512722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.513491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.514060 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.647246 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:00.655810 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:00.657272 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:00.658411 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-acb1a7fa-6c6e-4123-974d-e8e963d68b2f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.157226 May 16 15:18:00.658963 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 176/342] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:00 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:00.903201 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4a57fa40-bcbb-4ff2-8819-880074cac0ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:00.903863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4a57fa40-bcbb-4ff2-8819-880074cac0ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:00.911224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a57fa40-bcbb-4ff2-8819-880074cac0ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.921258 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a57fa40-bcbb-4ff2-8819-880074cac0ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.921258 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a57fa40-bcbb-4ff2-8819-880074cac0ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.921258 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a57fa40-bcbb-4ff2-8819-880074cac0ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:01.051483 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4a57fa40-bcbb-4ff2-8819-880074cac0ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:01.061585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4a57fa40-bcbb-4ff2-8819-880074cac0ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.162779 May 16 15:18:01.062186 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 167/343] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:00 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:01.678373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:01.678994 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:01.685663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:01.686117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:01.686887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:01.687320 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:01.825669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:01.834801 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:01.836363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:01.837525 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e4694926-e870-475e-b16d-79cc96beb453 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.163938 May 16 15:18:01.838084 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 177/344] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:01 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:02.079032 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9982fd0f-1590-4c3f-8c01-8572a9b9e261 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:02.079665 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9982fd0f-1590-4c3f-8c01-8572a9b9e261 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:02.086335 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9982fd0f-1590-4c3f-8c01-8572a9b9e261 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:02.086791 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9982fd0f-1590-4c3f-8c01-8572a9b9e261 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:02.087893 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9982fd0f-1590-4c3f-8c01-8572a9b9e261 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:02.088426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9982fd0f-1590-4c3f-8c01-8572a9b9e261 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:02.228760 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9982fd0f-1590-4c3f-8c01-8572a9b9e261 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:02.237529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9982fd0f-1590-4c3f-8c01-8572a9b9e261 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.162315 May 16 15:18:02.238111 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 168/345] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:02 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:02.856906 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:02.857580 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:02.864741 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:02.865204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:02.866303 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:02.866813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:03.005147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:03.014152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:03.015613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:03.016875 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7cffc1be-4045-489d-8a53-89c046e111cf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.164398 May 16 15:18:03.017403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 178/346] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:02 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:03.256339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-19250596-02a8-49e0-bd56-235a9ebf7b06 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:03.256937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-19250596-02a8-49e0-bd56-235a9ebf7b06 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:03.264376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-19250596-02a8-49e0-bd56-235a9ebf7b06 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:03.264825 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-19250596-02a8-49e0-bd56-235a9ebf7b06 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:03.265596 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-19250596-02a8-49e0-bd56-235a9ebf7b06 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:03.266030 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-19250596-02a8-49e0-bd56-235a9ebf7b06 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:03.402156 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-19250596-02a8-49e0-bd56-235a9ebf7b06 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:03.414356 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-19250596-02a8-49e0-bd56-235a9ebf7b06 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.161774 May 16 15:18:03.424071 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 169/347] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:03 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:04.037327 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:04.037931 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:04.045402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.045846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.046616 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.047054 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.194693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:04.203864 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:04.205360 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:04.206551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8f056a31-c618-4aed-8f1f-25b9899234ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.173326 May 16 15:18:04.207124 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 179/348] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:04 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:04.431859 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-beb55589-ba8b-4d0c-8508-8e921c9cd6dd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:04.432473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-beb55589-ba8b-4d0c-8508-8e921c9cd6dd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:04.438846 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-beb55589-ba8b-4d0c-8508-8e921c9cd6dd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.439292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-beb55589-ba8b-4d0c-8508-8e921c9cd6dd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.440099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-beb55589-ba8b-4d0c-8508-8e921c9cd6dd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.440527 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-beb55589-ba8b-4d0c-8508-8e921c9cd6dd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.577729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-beb55589-ba8b-4d0c-8508-8e921c9cd6dd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:04.585950 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-beb55589-ba8b-4d0c-8508-8e921c9cd6dd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.157978 May 16 15:18:04.586579 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 170/349] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:04 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:05.225847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:05.227117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:05.234695 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:05.235147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:05.235954 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:05.236426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:05.605696 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2f295266-6db1-4bb9-9880-0da094b8fb4f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:05.606606 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2f295266-6db1-4bb9-9880-0da094b8fb4f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:05.619603 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f295266-6db1-4bb9-9880-0da094b8fb4f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:05.635946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f295266-6db1-4bb9-9880-0da094b8fb4f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:05.635946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f295266-6db1-4bb9-9880-0da094b8fb4f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:05.635946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f295266-6db1-4bb9-9880-0da094b8fb4f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:05.636482 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:05.636482 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:05.637043 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:05.638245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-52473abc-e8a3-44ad-854a-9e5fe8fbce7f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.416556 May 16 15:18:05.649415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 180/350] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:05 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:05.754545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2f295266-6db1-4bb9-9880-0da094b8fb4f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:05.763185 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2f295266-6db1-4bb9-9880-0da094b8fb4f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1725 microversion: 2.1 time: 0.161990 May 16 15:18:05.764081 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 171/351] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:05 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:06.657476 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:06.658087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:06.664532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:06.670259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:06.670259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:06.670259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:06.781339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-256a2d67-fb1f-4d76-8652-1d13e2e377af tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:06.781947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-256a2d67-fb1f-4d76-8652-1d13e2e377af tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:06.788221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-256a2d67-fb1f-4d76-8652-1d13e2e377af tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:06.788660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-256a2d67-fb1f-4d76-8652-1d13e2e377af tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:06.789423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-256a2d67-fb1f-4d76-8652-1d13e2e377af tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:06.789902 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-256a2d67-fb1f-4d76-8652-1d13e2e377af tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:06.792399 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:06.800715 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:06.802258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:06.803408 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5c42a9ba-6118-4b1f-b7ee-307fe05e0083 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.149801 May 16 15:18:06.804220 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 181/352] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:06 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:06.916517 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-256a2d67-fb1f-4d76-8652-1d13e2e377af tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:06.924550 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-256a2d67-fb1f-4d76-8652-1d13e2e377af tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1702 microversion: 2.1 time: 0.146986 May 16 15:18:06.925114 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 172/353] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:06 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1702 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:06.941258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a84e46d8-bb21-41bc-95d5-08ed8c77fcc6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:06.947091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a84e46d8-bb21-41bc-95d5-08ed8c77fcc6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:06.947537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a84e46d8-bb21-41bc-95d5-08ed8c77fcc6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:06.969141 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a84e46d8-bb21-41bc-95d5-08ed8c77fcc6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Going to try to start instance {{(pid=117676) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 15:18:07.137397 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a84e46d8-bb21-41bc-95d5-08ed8c77fcc6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/action" status: 202 len: 0 microversion: 2.1 time: 0.199609 May 16 15:18:07.138138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 182/354] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:18:06 2022] POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:07.145836 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7aa28b52-fc30-4918-85d3-01f0e9027831 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:07.146722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7aa28b52-fc30-4918-85d3-01f0e9027831 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:07.152849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7aa28b52-fc30-4918-85d3-01f0e9027831 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:07.153672 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7aa28b52-fc30-4918-85d3-01f0e9027831 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:07.154077 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7aa28b52-fc30-4918-85d3-01f0e9027831 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:07.154509 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7aa28b52-fc30-4918-85d3-01f0e9027831 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:07.361377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7aa28b52-fc30-4918-85d3-01f0e9027831 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:07.369694 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7aa28b52-fc30-4918-85d3-01f0e9027831 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1711 microversion: 2.1 time: 0.227627 May 16 15:18:07.370277 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 173/355] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:07 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1711 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:07.822178 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:07.822869 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:07.829351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:07.829797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:07.830563 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:07.830996 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:08.062038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:08.071070 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:08.072756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:08.074721 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-94659f28-16d4-4380-8959-05e302c4a641 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.256675 May 16 15:18:08.075339 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 183/356] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:07 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:08.387468 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-09fadf5c-3c6a-4fa9-96e0-588606d6cf9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:08.388277 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-09fadf5c-3c6a-4fa9-96e0-588606d6cf9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:08.394767 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-09fadf5c-3c6a-4fa9-96e0-588606d6cf9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:08.395212 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-09fadf5c-3c6a-4fa9-96e0-588606d6cf9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:08.396013 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-09fadf5c-3c6a-4fa9-96e0-588606d6cf9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:08.396709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-09fadf5c-3c6a-4fa9-96e0-588606d6cf9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:08.524498 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-09fadf5c-3c6a-4fa9-96e0-588606d6cf9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:08.532352 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-09fadf5c-3c6a-4fa9-96e0-588606d6cf9f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1711 microversion: 2.1 time: 0.149964 May 16 15:18:08.532918 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 174/357] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:08 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1711 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:09.093558 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:09.094189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:09.100464 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:09.100849 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:09.101601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:09.102029 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:09.227842 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:09.236770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:09.238237 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:09.239449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-01ce8ef0-8116-4319-b045-454de5dabf59 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.150575 May 16 15:18:09.240047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 184/358] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:09 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:09.549503 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b3c03efd-983f-4738-845e-c54748d3d6f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:09.550114 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b3c03efd-983f-4738-845e-c54748d3d6f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:09.556464 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b3c03efd-983f-4738-845e-c54748d3d6f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:09.556910 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b3c03efd-983f-4738-845e-c54748d3d6f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:09.557700 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b3c03efd-983f-4738-845e-c54748d3d6f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:09.558160 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b3c03efd-983f-4738-845e-c54748d3d6f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:09.686225 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b3c03efd-983f-4738-845e-c54748d3d6f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:09.693903 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b3c03efd-983f-4738-845e-c54748d3d6f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1715 microversion: 2.1 time: 0.148293 May 16 15:18:09.694487 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 175/359] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:09 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:10.257334 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:10.257973 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:10.265017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:10.265466 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:10.266227 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:10.266698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:10.393162 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:10.401608 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:10.403073 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:10.404248 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5852325b-2140-4003-bb66-134a7292730c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.150793 May 16 15:18:10.404803 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 185/360] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:10 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:11.422160 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:11.422786 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:11.429116 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:11.429582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:11.430341 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:11.430772 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:11.560532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:11.568616 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:11.570090 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:11.571232 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-476c0491-86c7-4492-9a48-f61184bec447 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.153011 May 16 15:18:11.571808 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 176/361] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:11 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:12.590992 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:12.591604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:12.598035 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:12.598486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:12.599258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:12.599722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:12.723077 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:12.731279 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:12.732780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:12.733918 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b56146db-87da-4506-85b0-7c884987b5f3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.147584 May 16 15:18:12.734470 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 186/362] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:12 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:13.752080 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:13.752693 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:13.759033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:13.759479 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:13.760269 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:13.760705 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:13.889414 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:13.897947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:13.899471 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:13.900666 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-20d17d36-ab79-41a7-89dc-a6b0a62e951a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.152537 May 16 15:18:13.901409 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 177/363] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:13 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:14.919055 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:14.921118 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:14.925925 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:14.926369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:14.927155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:14.927590 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:15.056709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:15.065565 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:15.067044 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:15.068211 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-620a42f2-2050-4adc-8fb1-726120776023 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.153843 May 16 15:18:15.068764 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 187/364] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:14 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:18:15.941064 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-0fdb8f53-42c8-4833-ad54-1988747064bb req-a4a5e283-8e30-4cf5-a69a-755d4bd6fcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893feede-4052-4c51-96a2-1f93510d1f5f", "name": "network-vif-plugged", "status": "completed", "tag": "7be8453f-3109-4b92-981a-837b09373d42"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:15.950449 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-0fdb8f53-42c8-4833-ad54-1988747064bb req-a4a5e283-8e30-4cf5-a69a-755d4bd6fcdc service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:15.950884 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-0fdb8f53-42c8-4833-ad54-1988747064bb req-a4a5e283-8e30-4cf5-a69a-755d4bd6fcdc service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:15.961545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-0fdb8f53-42c8-4833-ad54-1988747064bb req-a4a5e283-8e30-4cf5-a69a-755d4bd6fcdc service nova] Creating event network-vif-plugged:7be8453f-3109-4b92-981a-837b09373d42 for instance 893feede-4052-4c51-96a2-1f93510d1f5f on hv-cinder-84175 May 16 15:18:15.966727 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-0fdb8f53-42c8-4833-ad54-1988747064bb req-a4a5e283-8e30-4cf5-a69a-755d4bd6fcdc service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030599 May 16 15:18:15.967370 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 178/365] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:16.086450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:16.087155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:16.093729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:16.094174 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:16.094930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:16.095362 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:16.222031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:16.230699 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:16.232284 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:16.233440 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-934db22c-08e8-40ab-b7e5-9415eafd44a7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.150823 May 16 15:18:16.233991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 188/366] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:16 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:17.253229 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:17.253962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:17.260699 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:17.261149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:17.261951 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:17.262383 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:17.386480 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:17.394617 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:17.396352 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:17.397485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b981b629-4b70-4b92-9678-478e1cd5da83 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.148620 May 16 15:18:17.398041 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 179/367] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:17 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:18.415969 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:18.416578 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:18.423513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:18.423993 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:18.424759 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:18.425196 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:18.556102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:18.565340 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:18.566973 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:18.568172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-29680bec-78a6-4386-bfe9-10351e3651bc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1808 microversion: 2.20 time: 0.156137 May 16 15:18:18.574468 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 189/368] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:18 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:18:19.586043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:19.586650 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:19.593623 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:19.594065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:19.594821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:19.595248 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:19.722972 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:19.731309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:19.733396 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:19.734532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-eb801feb-250b-4b3b-b67f-54adfaa65403 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1795 microversion: 2.20 time: 0.152353 May 16 15:18:19.735079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 180/369] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:18:19 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:18:21.106005 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-879dd960-5e62-46da-93e9-d27e2dc3c63c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:21.107109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-879dd960-5e62-46da-93e9-d27e2dc3c63c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:21.113342 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-879dd960-5e62-46da-93e9-d27e2dc3c63c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.113787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-879dd960-5e62-46da-93e9-d27e2dc3c63c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.114546 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-879dd960-5e62-46da-93e9-d27e2dc3c63c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.114975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-879dd960-5e62-46da-93e9-d27e2dc3c63c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.138344 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-879dd960-5e62-46da-93e9-d27e2dc3c63c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d/ips" status: 200 len: 149 microversion: 2.1 time: 0.036309 May 16 15:18:21.138896 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 190/370] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:18:21 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:21.149679 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e3fa26d-3886-4e95-b115-3b0dd5141036"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:21.150719 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:21.157563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.158351 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.159112 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.159544 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.236232 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Invalid volume: volume 4e3fa26d-3886-4e95-b115-3b0dd5141036 is already attached to instances: a4b1e4cf-ff7e-43d2-9351-ca6206651db4 May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: POST /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d/os-volume_attachments HTTP/1.1 May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 74 May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:18:21.237944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {"volumeAttachment": {"volumeId": "4e3fa26d-3886-4e95-b115-3b0dd5141036"}} May 16 15:18:21.239326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Invalid volume: volume 4e3fa26d-3886-4e95-b115-3b0dd5141036 is already attached to instances: a4b1e4cf-ff7e-43d2-9351-ca6206651db4 May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'server_id': '71e20c89-9049-4b13-a531-2c2e361ed84d', 'body': {'volumeAttachment': {'volumeId': '4e3fa26d-3886-4e95-b115-3b0dd5141036'}}} May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e3fa26d-3886-4e95-b115-3b0dd5141036 is already attached to instances: a4b1e4cf-ff7e-43d2-9351-ca6206651db4 May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:21.240304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e3fa26d-3886-4e95-b115-3b0dd5141036 is already attached to instances: a4b1e4cf-ff7e-43d2-9351-ca6206651db4 May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:21.241900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:21.243388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:21.243388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:18:21.243388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:18:21.243388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e3fa26d-3886-4e95-b115-3b0dd5141036 is already attached to instances: a4b1e4cf-ff7e-43d2-9351-ca6206651db4 May 16 15:18:21.243388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:21.243388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 400 to user: Invalid volume: volume 4e3fa26d-3886-4e95-b115-3b0dd5141036 is already attached to instances: a4b1e4cf-ff7e-43d2-9351-ca6206651db4 {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:18:21.243388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8554013f-b0c8-4a23-b554-3f7cbb1a02af tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094157 May 16 15:18:21.243388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 181/371] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:18:21 2022] POST /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:18:21.248160 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cd6664ba-1ffd-4e0e-8f0c-6d0291094a68 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:21.248650 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cd6664ba-1ffd-4e0e-8f0c-6d0291094a68 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:21.254494 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cd6664ba-1ffd-4e0e-8f0c-6d0291094a68 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.254940 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cd6664ba-1ffd-4e0e-8f0c-6d0291094a68 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.255716 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cd6664ba-1ffd-4e0e-8f0c-6d0291094a68 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.256148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cd6664ba-1ffd-4e0e-8f0c-6d0291094a68 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.280555 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cd6664ba-1ffd-4e0e-8f0c-6d0291094a68 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:18:21.582000 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cd6664ba-1ffd-4e0e-8f0c-6d0291094a68 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 204 len: 0 microversion: 2.1 time: 0.337366 May 16 15:18:21.582595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 191/372] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:18:21 2022] DELETE /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:18:21.590581 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d3a9c32a-7e0b-403a-9af2-b5cb7c864952 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:21.591844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d3a9c32a-7e0b-403a-9af2-b5cb7c864952 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:21.600711 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3a9c32a-7e0b-403a-9af2-b5cb7c864952 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.601160 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3a9c32a-7e0b-403a-9af2-b5cb7c864952 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.601938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3a9c32a-7e0b-403a-9af2-b5cb7c864952 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.602376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3a9c32a-7e0b-403a-9af2-b5cb7c864952 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.725883 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d3a9c32a-7e0b-403a-9af2-b5cb7c864952 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:21.733525 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d3a9c32a-7e0b-403a-9af2-b5cb7c864952 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1680 microversion: 2.1 time: 0.146768 May 16 15:18:21.734087 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 182/373] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:21 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:22.042143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b7e0c953-8828-4ef1-8f2c-48c21c083460 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd2d581-9989-4032-ac4c-7dc81a16966f"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:22.043329 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b7e0c953-8828-4ef1-8f2c-48c21c083460 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:22.049188 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b7e0c953-8828-4ef1-8f2c-48c21c083460 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:22.049638 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b7e0c953-8828-4ef1-8f2c-48c21c083460 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:22.050393 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b7e0c953-8828-4ef1-8f2c-48c21c083460 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:22.050831 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b7e0c953-8828-4ef1-8f2c-48c21c083460 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:22.751582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-64379ded-02a1-4ca4-a708-238e18c61c61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:22.752212 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-64379ded-02a1-4ca4-a708-238e18c61c61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:22.758535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-64379ded-02a1-4ca4-a708-238e18c61c61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:22.758980 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-64379ded-02a1-4ca4-a708-238e18c61c61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:22.759776 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-64379ded-02a1-4ca4-a708-238e18c61c61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:22.760214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-64379ded-02a1-4ca4-a708-238e18c61c61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:22.888840 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-64379ded-02a1-4ca4-a708-238e18c61c61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:22.896352 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-64379ded-02a1-4ca4-a708-238e18c61c61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1680 microversion: 2.1 time: 0.148658 May 16 15:18:22.896921 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 183/374] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:22 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:23.685150 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b7e0c953-8828-4ef1-8f2c-48c21c083460 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.645969 May 16 15:18:23.685803 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 192/375] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:18:22 2022] POST /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 194 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:23.914300 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-989b5631-cbfc-4855-9737-4251fb15de8c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:23.914907 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-989b5631-cbfc-4855-9737-4251fb15de8c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:23.948777 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-989b5631-cbfc-4855-9737-4251fb15de8c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:23.948777 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-989b5631-cbfc-4855-9737-4251fb15de8c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:23.948777 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-989b5631-cbfc-4855-9737-4251fb15de8c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:23.948777 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-989b5631-cbfc-4855-9737-4251fb15de8c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:24.164251 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-989b5631-cbfc-4855-9737-4251fb15de8c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:24.178545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-989b5631-cbfc-4855-9737-4251fb15de8c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1680 microversion: 2.1 time: 0.262838 May 16 15:18:24.178545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 184/376] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:23 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1680 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:24.350934 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-2d1583f5-d90e-46b0-86af-9789b0d07286 req-3a4d5fc9-8e92-4fb4-9638-8bd8fc4647e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e20c89-9049-4b13-a531-2c2e361ed84d", "name": "network-vif-deleted", "tag": "418db1a8-e530-4a38-a317-c50a19a4aed2"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:24.360756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2d1583f5-d90e-46b0-86af-9789b0d07286 req-3a4d5fc9-8e92-4fb4-9638-8bd8fc4647e8 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:24.361197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2d1583f5-d90e-46b0-86af-9789b0d07286 req-3a4d5fc9-8e92-4fb4-9638-8bd8fc4647e8 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:24.372039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-2d1583f5-d90e-46b0-86af-9789b0d07286 req-3a4d5fc9-8e92-4fb4-9638-8bd8fc4647e8 service nova] Creating event network-vif-deleted:418db1a8-e530-4a38-a317-c50a19a4aed2 for instance 71e20c89-9049-4b13-a531-2c2e361ed84d on hv-cinder-84175 May 16 15:18:24.377315 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-2d1583f5-d90e-46b0-86af-9789b0d07286 req-3a4d5fc9-8e92-4fb4-9638-8bd8fc4647e8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030614 May 16 15:18:24.378147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 193/377] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:25.191430 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:25.192077 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:25.198762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:25.199235 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:25.200626 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:25.201237 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:25.233510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:25.233964 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:25.238622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lazy-loading 'fault' on Instance uuid 71e20c89-9049-4b13-a531-2c2e361ed84d {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:18:25.284842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:25.292972 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-656bd51d-764e-483e-a8f8-2a9692cdb1dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 200 len: 1331 microversion: 2.1 time: 0.105949 May 16 15:18:25.299088 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 185/378] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:25 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:26.312298 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:26.312991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:26.319063 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:26.319513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:26.320295 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:26.320727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:26.333831 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d HTTP/1.1 May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:18:26.335474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:18:26.336957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '71e20c89-9049-4b13-a531-2c2e361ed84d'} May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:18:26.337824 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:18:26.339228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:26.340483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:18:26.340483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ab104f7e-f0f8-4f1f-bd01-4290477159e1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 404 len: 111 microversion: 2.1 time: 0.029882 May 16 15:18:26.340483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 194/379] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:26 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:18:26.346425 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a9308653-8876-4fbd-9c7f-be6413549448 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '.version_select at 0x7f0c8808edc0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:26.417754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a9308653-8876-4fbd-9c7f-be6413549448 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-923677161" status: 202 len: 0 microversion: 2.1 time: 0.074946 May 16 15:18:26.418338 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 186/380] 10.222.0.71 () {58 vars in 1217 bytes} [Mon May 16 15:18:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-923677161 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:18:27.244025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-db73f5dd-aa5d-44ff-a84a-43c0fd9bf129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:27.244527 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-db73f5dd-aa5d-44ff-a84a-43c0fd9bf129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:27.251085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-db73f5dd-aa5d-44ff-a84a-43c0fd9bf129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.251537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-db73f5dd-aa5d-44ff-a84a-43c0fd9bf129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.252332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-db73f5dd-aa5d-44ff-a84a-43c0fd9bf129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.252782 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-db73f5dd-aa5d-44ff-a84a-43c0fd9bf129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.378271 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-db73f5dd-aa5d-44ff-a84a-43c0fd9bf129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lazy-loading 'services' on Instance uuid a4b1e4cf-ff7e-43d2-9351-ca6206651db4 {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:18:27.609821 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-db73f5dd-aa5d-44ff-a84a-43c0fd9bf129 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments/4e3fa26d-3886-4e95-b115-3b0dd5141036" status: 202 len: 0 microversion: 2.1 time: 0.369520 May 16 15:18:27.610416 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 195/381] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:18:27 2022] DELETE /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments/4e3fa26d-3886-4e95-b115-3b0dd5141036 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:27.619643 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e1ced9d6-1856-4a00-9b47-47f4b846a2c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:27.620584 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e1ced9d6-1856-4a00-9b47-47f4b846a2c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:27.627925 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e1ced9d6-1856-4a00-9b47-47f4b846a2c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.628376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e1ced9d6-1856-4a00-9b47-47f4b846a2c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.629151 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e1ced9d6-1856-4a00-9b47-47f4b846a2c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.629587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e1ced9d6-1856-4a00-9b47-47f4b846a2c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.662610 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e1ced9d6-1856-4a00-9b47-47f4b846a2c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047721 May 16 15:18:27.663176 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 187/382] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:18:27 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:28.676084 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f83ca6c7-6bb8-4828-9684-2642a58723ac tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:28.677073 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f83ca6c7-6bb8-4828-9684-2642a58723ac tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:28.683108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f83ca6c7-6bb8-4828-9684-2642a58723ac tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:28.683551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f83ca6c7-6bb8-4828-9684-2642a58723ac tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:28.684346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f83ca6c7-6bb8-4828-9684-2642a58723ac tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:28.685018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f83ca6c7-6bb8-4828-9684-2642a58723ac tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:28.713325 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f83ca6c7-6bb8-4828-9684-2642a58723ac tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 May 16 15:18:28.713863 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 196/383] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:18:28 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:29.725244 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4789fdc6-fa90-4d64-99f4-f9cf6e3d29a7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:29.726154 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4789fdc6-fa90-4d64-99f4-f9cf6e3d29a7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:29.733229 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4789fdc6-fa90-4d64-99f4-f9cf6e3d29a7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:29.733669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4789fdc6-fa90-4d64-99f4-f9cf6e3d29a7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:29.734421 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4789fdc6-fa90-4d64-99f4-f9cf6e3d29a7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:29.734849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4789fdc6-fa90-4d64-99f4-f9cf6e3d29a7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:29.763705 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4789fdc6-fa90-4d64-99f4-f9cf6e3d29a7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042321 May 16 15:18:29.764251 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 188/384] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:18:29 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:30.774622 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8d2514d2-f040-4a73-b28e-8a96f06a90e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:30.775539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8d2514d2-f040-4a73-b28e-8a96f06a90e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:30.783081 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8d2514d2-f040-4a73-b28e-8a96f06a90e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:30.783528 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8d2514d2-f040-4a73-b28e-8a96f06a90e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:30.784323 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8d2514d2-f040-4a73-b28e-8a96f06a90e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:30.784756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8d2514d2-f040-4a73-b28e-8a96f06a90e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:30.814351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8d2514d2-f040-4a73-b28e-8a96f06a90e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043886 May 16 15:18:30.814903 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 197/385] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:18:30 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:31.181709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-605db404-3637-4028-96fc-ee726e6ca7b6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:31.182817 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-605db404-3637-4028-96fc-ee726e6ca7b6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:31.190259 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-605db404-3637-4028-96fc-ee726e6ca7b6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:31.190745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-605db404-3637-4028-96fc-ee726e6ca7b6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:31.191523 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-605db404-3637-4028-96fc-ee726e6ca7b6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:31.192019 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-605db404-3637-4028-96fc-ee726e6ca7b6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:31.217035 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-605db404-3637-4028-96fc-ee726e6ca7b6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lazy-loading 'flavor' on Instance uuid 4d612141-6fe0-4d49-b1aa-071acc497104 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:18:31.540290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-605db404-3637-4028-96fc-ee726e6ca7b6 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/action" status: 200 len: 32 microversion: 2.1 time: 0.362406 May 16 15:18:31.541100 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 189/386] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:18:31 2022] POST /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:18:31.551825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e1bcad6a-c36c-43db-8406-8f7660bcb87f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:31.552828 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e1bcad6a-c36c-43db-8406-8f7660bcb87f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:31.559111 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e1bcad6a-c36c-43db-8406-8f7660bcb87f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:31.564539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e1bcad6a-c36c-43db-8406-8f7660bcb87f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:31.564539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e1bcad6a-c36c-43db-8406-8f7660bcb87f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:31.564539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e1bcad6a-c36c-43db-8406-8f7660bcb87f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:31.697951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e1bcad6a-c36c-43db-8406-8f7660bcb87f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:31.705932 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e1bcad6a-c36c-43db-8406-8f7660bcb87f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.158839 May 16 15:18:31.706492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 198/387] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:31 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:31.826893 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2e2510b5-fea3-4a80-a0f6-d69e0fbf2613 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:31.828097 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2e2510b5-fea3-4a80-a0f6-d69e0fbf2613 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:31.834511 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2e2510b5-fea3-4a80-a0f6-d69e0fbf2613 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:31.834967 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2e2510b5-fea3-4a80-a0f6-d69e0fbf2613 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:31.835824 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2e2510b5-fea3-4a80-a0f6-d69e0fbf2613 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:31.836254 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2e2510b5-fea3-4a80-a0f6-d69e0fbf2613 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:31.869267 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2e2510b5-fea3-4a80-a0f6-d69e0fbf2613 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 May 16 15:18:31.870048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 190/388] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:18:31 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:32.723823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a6e6c886-337c-4f25-9a3c-03e28d6fc938 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:32.724413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a6e6c886-337c-4f25-9a3c-03e28d6fc938 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:32.730708 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a6e6c886-337c-4f25-9a3c-03e28d6fc938 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:32.731152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a6e6c886-337c-4f25-9a3c-03e28d6fc938 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:32.731946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a6e6c886-337c-4f25-9a3c-03e28d6fc938 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:32.732552 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a6e6c886-337c-4f25-9a3c-03e28d6fc938 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:32.860402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a6e6c886-337c-4f25-9a3c-03e28d6fc938 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:32.868294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a6e6c886-337c-4f25-9a3c-03e28d6fc938 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.148228 May 16 15:18:32.868869 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 199/389] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:32 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:32.880161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1cb29dc7-f9c4-4da6-b74c-9d46501492bf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:32.881069 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1cb29dc7-f9c4-4da6-b74c-9d46501492bf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:32.887247 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1cb29dc7-f9c4-4da6-b74c-9d46501492bf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:32.887720 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1cb29dc7-f9c4-4da6-b74c-9d46501492bf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:32.888471 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1cb29dc7-f9c4-4da6-b74c-9d46501492bf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:32.889444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1cb29dc7-f9c4-4da6-b74c-9d46501492bf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:32.917566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1cb29dc7-f9c4-4da6-b74c-9d46501492bf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041256 May 16 15:18:32.918970 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 191/390] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:18:32 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:18:32.974606 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e32c9af0-73af-45cc-bb46-2260af3a5464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:32.975032 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e32c9af0-73af-45cc-bb46-2260af3a5464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:32.980779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e32c9af0-73af-45cc-bb46-2260af3a5464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:32.981225 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e32c9af0-73af-45cc-bb46-2260af3a5464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:32.981985 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e32c9af0-73af-45cc-bb46-2260af3a5464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:32.982417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e32c9af0-73af-45cc-bb46-2260af3a5464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:33.006188 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e32c9af0-73af-45cc-bb46-2260af3a5464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:18:33.251047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e32c9af0-73af-45cc-bb46-2260af3a5464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 204 len: 0 microversion: 2.1 time: 0.279848 May 16 15:18:33.251534 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 200/391] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:18:32 2022] DELETE /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:18:33.259516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-65e6f626-135f-4de5-8bb1-fdd9131ac85f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:33.260264 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-65e6f626-135f-4de5-8bb1-fdd9131ac85f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:33.266916 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65e6f626-135f-4de5-8bb1-fdd9131ac85f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:33.267364 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65e6f626-135f-4de5-8bb1-fdd9131ac85f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:33.268157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65e6f626-135f-4de5-8bb1-fdd9131ac85f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:33.268586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65e6f626-135f-4de5-8bb1-fdd9131ac85f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:33.398240 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-65e6f626-135f-4de5-8bb1-fdd9131ac85f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:33.405814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-65e6f626-135f-4de5-8bb1-fdd9131ac85f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1683 microversion: 2.1 time: 0.150126 May 16 15:18:33.406380 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 192/392] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:33 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:33.885908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dde887d6-0a9a-443b-b679-972c1802708f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:33.886619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dde887d6-0a9a-443b-b679-972c1802708f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:33.893415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dde887d6-0a9a-443b-b679-972c1802708f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:33.894825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dde887d6-0a9a-443b-b679-972c1802708f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:33.894825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dde887d6-0a9a-443b-b679-972c1802708f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:33.895102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dde887d6-0a9a-443b-b679-972c1802708f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:34.264601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dde887d6-0a9a-443b-b679-972c1802708f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:34.272549 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dde887d6-0a9a-443b-b679-972c1802708f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.390897 May 16 15:18:34.273102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 201/393] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:33 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:34.423038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c4dd937a-2087-4436-9a27-0d973e0e5bd1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:34.423666 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c4dd937a-2087-4436-9a27-0d973e0e5bd1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:34.430072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c4dd937a-2087-4436-9a27-0d973e0e5bd1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:34.430523 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c4dd937a-2087-4436-9a27-0d973e0e5bd1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:34.431296 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c4dd937a-2087-4436-9a27-0d973e0e5bd1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:34.431764 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c4dd937a-2087-4436-9a27-0d973e0e5bd1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:34.555838 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c4dd937a-2087-4436-9a27-0d973e0e5bd1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:34.563929 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c4dd937a-2087-4436-9a27-0d973e0e5bd1 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1683 microversion: 2.1 time: 0.145376 May 16 15:18:34.564485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 193/394] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:34 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:35.290253 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b9c689b5-7d16-479c-bb0f-b39f5a3d92fb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:35.291013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b9c689b5-7d16-479c-bb0f-b39f5a3d92fb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:35.297440 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b9c689b5-7d16-479c-bb0f-b39f5a3d92fb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:35.297895 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b9c689b5-7d16-479c-bb0f-b39f5a3d92fb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:35.298675 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b9c689b5-7d16-479c-bb0f-b39f5a3d92fb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:35.299115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b9c689b5-7d16-479c-bb0f-b39f5a3d92fb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:35.522653 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b9c689b5-7d16-479c-bb0f-b39f5a3d92fb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:35.530616 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b9c689b5-7d16-479c-bb0f-b39f5a3d92fb tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.244462 May 16 15:18:35.536119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 202/395] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:35 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:35.580813 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b55fcc1d-84bb-4999-bd0c-54e62f936950 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:35.581442 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b55fcc1d-84bb-4999-bd0c-54e62f936950 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:35.587696 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b55fcc1d-84bb-4999-bd0c-54e62f936950 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:35.588139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b55fcc1d-84bb-4999-bd0c-54e62f936950 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:35.588894 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b55fcc1d-84bb-4999-bd0c-54e62f936950 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:35.589322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b55fcc1d-84bb-4999-bd0c-54e62f936950 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:35.829309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b55fcc1d-84bb-4999-bd0c-54e62f936950 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:35.836587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b55fcc1d-84bb-4999-bd0c-54e62f936950 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1683 microversion: 2.1 time: 0.260299 May 16 15:18:35.837164 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 194/396] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:35 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1683 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:36.258334 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-446f095e-9763-44dd-83ac-8478f2e8a041 req-a06e3f9e-1a65-479c-aeb9-2c7db2ce7966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b1e4cf-ff7e-43d2-9351-ca6206651db4", "name": "network-vif-deleted", "tag": "9d2d9f44-9262-4053-b198-1c13754b68fd"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:36.275258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-446f095e-9763-44dd-83ac-8478f2e8a041 req-a06e3f9e-1a65-479c-aeb9-2c7db2ce7966 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:36.275258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-446f095e-9763-44dd-83ac-8478f2e8a041 req-a06e3f9e-1a65-479c-aeb9-2c7db2ce7966 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:36.280472 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-446f095e-9763-44dd-83ac-8478f2e8a041 req-a06e3f9e-1a65-479c-aeb9-2c7db2ce7966 service nova] Creating event network-vif-deleted:9d2d9f44-9262-4053-b198-1c13754b68fd for instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 on hv-cinder-84175 May 16 15:18:36.285508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-446f095e-9763-44dd-83ac-8478f2e8a041 req-a06e3f9e-1a65-479c-aeb9-2c7db2ce7966 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030763 May 16 15:18:36.286107 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 203/397] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:36.548770 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b45366d6-bbdd-4af0-8ecd-3ba6304b8755 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:36.549418 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b45366d6-bbdd-4af0-8ecd-3ba6304b8755 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:36.555656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b45366d6-bbdd-4af0-8ecd-3ba6304b8755 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:36.556123 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b45366d6-bbdd-4af0-8ecd-3ba6304b8755 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:36.556893 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b45366d6-bbdd-4af0-8ecd-3ba6304b8755 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:36.557334 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b45366d6-bbdd-4af0-8ecd-3ba6304b8755 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:36.718102 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b45366d6-bbdd-4af0-8ecd-3ba6304b8755 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:36.725935 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b45366d6-bbdd-4af0-8ecd-3ba6304b8755 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.181690 May 16 15:18:36.726514 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 195/398] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:36 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:36.855194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:36.855909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:36.862548 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:36.862997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:36.863786 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:36.864212 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:36.896872 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:36.897325 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:36.897779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lazy-loading 'fault' on Instance uuid a4b1e4cf-ff7e-43d2-9351-ca6206651db4 {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:18:36.945654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:36.948820 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-92b5693a-9cab-4c9c-b694-c4d03d7de869 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 200 len: 1332 microversion: 2.1 time: 0.098110 May 16 15:18:36.949601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 204/399] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:36 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:37.744143 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-63e69e15-6ccf-4c4a-b355-f50b05b4d588 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:37.744799 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-63e69e15-6ccf-4c4a-b355-f50b05b4d588 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:37.751552 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63e69e15-6ccf-4c4a-b355-f50b05b4d588 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:37.752026 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63e69e15-6ccf-4c4a-b355-f50b05b4d588 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:37.752780 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63e69e15-6ccf-4c4a-b355-f50b05b4d588 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:37.753212 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-63e69e15-6ccf-4c4a-b355-f50b05b4d588 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:37.880636 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-63e69e15-6ccf-4c4a-b355-f50b05b4d588 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:37.888248 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-63e69e15-6ccf-4c4a-b355-f50b05b4d588 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.147924 May 16 15:18:37.889193 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 196/400] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:37 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:37.966489 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:37.967135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:37.973850 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:37.974304 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:37.975095 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:37.975536 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:37.989319 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 HTTP/1.1 May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:18:37.990991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:18:37.992561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'a4b1e4cf-ff7e-43d2-9351-ca6206651db4'} May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:18:37.993430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:18:37.999017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:18:38.001512 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:18:38.001512 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2d630cfd-32dc-4cce-8e28-4b2343dd808b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 404 len: 111 microversion: 2.1 time: 0.029924 May 16 15:18:38.001512 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 205/401] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:37 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:18:38.001927 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6688558a-53eb-4b7e-bec2-bbfd30b3d54e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '.version_select at 0x7f0c880dc940>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:38.076973 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6688558a-53eb-4b7e-bec2-bbfd30b3d54e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799433840" status: 202 len: 0 microversion: 2.1 time: 0.079559 May 16 15:18:38.077533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 197/402] 10.222.0.71 () {58 vars in 1220 bytes} [Mon May 16 15:18:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799433840 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:38.791707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0beab572-e656-4cb0-a831-bc8671a0c247 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: .version_select at 0x7f0c8817faf0>, body: {"keypair": {"name": "tempest-keypair-140393480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSGKLZo/EL1PVRryapcHW5RNW3aTcY5R0O/UNotrBudrNs1XJpTPDxNI6XubsoGHfmjCttwE2uNpSGV67Hs5bHjCrH1BfhTzyDfRqFw6+f3nV2icvBmPICR0DCvVVKm+Q=="}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:38.805659 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-0beab572-e656-4cb0-a831-bc8671a0c247 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:18:38.809358 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-0beab572-e656-4cb0-a831-bc8671a0c247 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for user d38cdf40e33b47d8aa79e029cded7503 and project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:18:38.883637 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0beab572-e656-4cb0-a831-bc8671a0c247 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095839 May 16 15:18:38.884284 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 206/403] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:18:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:38.907141 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-323e9a03-9a60-40e9-ba02-841231954bed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:38.907889 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-323e9a03-9a60-40e9-ba02-841231954bed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:38.913953 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-323e9a03-9a60-40e9-ba02-841231954bed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:38.914397 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-323e9a03-9a60-40e9-ba02-841231954bed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:38.915164 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-323e9a03-9a60-40e9-ba02-841231954bed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:38.915591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-323e9a03-9a60-40e9-ba02-841231954bed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:39.077289 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-323e9a03-9a60-40e9-ba02-841231954bed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:39.085997 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-323e9a03-9a60-40e9-ba02-841231954bed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.183667 May 16 15:18:39.094528 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 198/404] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:38 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:40.111287 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8b05ceed-830a-4e94-962c-1406c96d2501 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:40.111932 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8b05ceed-830a-4e94-962c-1406c96d2501 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:40.118762 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8b05ceed-830a-4e94-962c-1406c96d2501 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:40.119216 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8b05ceed-830a-4e94-962c-1406c96d2501 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:40.120035 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8b05ceed-830a-4e94-962c-1406c96d2501 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:40.120472 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8b05ceed-830a-4e94-962c-1406c96d2501 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:40.316562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8b05ceed-830a-4e94-962c-1406c96d2501 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:40.325282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8b05ceed-830a-4e94-962c-1406c96d2501 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.217715 May 16 15:18:40.326514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 207/405] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:40 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:41.185300 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1109841161", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a605965-a559-434b-a7bc-1500d5306bfd"}], "security_groups": [{"name": "tempest-securitygroup--1665931358"}], "key_name": "tempest-keypair-140393480", "user_data": "}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:41.284047 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] validate_networks() for [('1a605965-a559-434b-a7bc-1500d5306bfd', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:18:41.345192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d4a819b6-ae91-4873-9740-548dfbeeac1e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:41.346005 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d4a819b6-ae91-4873-9740-548dfbeeac1e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:41.353027 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d4a819b6-ae91-4873-9740-548dfbeeac1e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:41.353554 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d4a819b6-ae91-4873-9740-548dfbeeac1e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:41.354296 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d4a819b6-ae91-4873-9740-548dfbeeac1e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:41.355092 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d4a819b6-ae91-4873-9740-548dfbeeac1e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:41.548409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d4a819b6-ae91-4873-9740-548dfbeeac1e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:41.556413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d4a819b6-ae91-4873-9740-548dfbeeac1e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.216372 May 16 15:18:41.557006 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 208/406] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:41 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:41.696423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:18:41.696849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:18:41.697327 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:18:41.697770 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:18:41.698183 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:18:41.706960 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:41.707344 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:41.708184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:41.708625 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:41.725177 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:18:41.729001 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for user d38cdf40e33b47d8aa79e029cded7503 and project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:18:41.740419 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:18:41.742663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:18:41.875590 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ba95f7df-c884-4c8a-83c5-ae224e09e464 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.694641 May 16 15:18:41.876486 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 199/407] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:18:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:18:41.886145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7b7605ac-62ef-43bc-a47c-23fe7d585a6a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:41.886765 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7b7605ac-62ef-43bc-a47c-23fe7d585a6a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:41.941693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7b7605ac-62ef-43bc-a47c-23fe7d585a6a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:41.948516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7b7605ac-62ef-43bc-a47c-23fe7d585a6a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1241 microversion: 2.1 time: 0.066169 May 16 15:18:41.949082 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 209/408] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:41 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:42.574847 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ff8d8300-7559-48cd-ac91-f97cebee08af tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:42.575365 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ff8d8300-7559-48cd-ac91-f97cebee08af tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:42.581927 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ff8d8300-7559-48cd-ac91-f97cebee08af tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:42.582369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ff8d8300-7559-48cd-ac91-f97cebee08af tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:42.583131 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ff8d8300-7559-48cd-ac91-f97cebee08af tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:42.583561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ff8d8300-7559-48cd-ac91-f97cebee08af tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:42.712876 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ff8d8300-7559-48cd-ac91-f97cebee08af tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:42.721269 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ff8d8300-7559-48cd-ac91-f97cebee08af tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.150872 May 16 15:18:42.721828 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 200/409] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:42 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:42.966486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-90d6d96f-a315-4820-bd91-e8d236d39c2e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:42.967093 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-90d6d96f-a315-4820-bd91-e8d236d39c2e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:42.975666 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-90d6d96f-a315-4820-bd91-e8d236d39c2e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:42.976109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-90d6d96f-a315-4820-bd91-e8d236d39c2e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:42.979194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-90d6d96f-a315-4820-bd91-e8d236d39c2e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:42.979194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-90d6d96f-a315-4820-bd91-e8d236d39c2e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:43.042135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-90d6d96f-a315-4820-bd91-e8d236d39c2e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:43.049733 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-90d6d96f-a315-4820-bd91-e8d236d39c2e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1237 microversion: 2.1 time: 0.088318 May 16 15:18:43.050312 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 210/410] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:42 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:43.739006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-398464d0-4d92-434a-9278-948a93439656 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:43.739701 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-398464d0-4d92-434a-9278-948a93439656 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:43.746635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-398464d0-4d92-434a-9278-948a93439656 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:43.747197 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-398464d0-4d92-434a-9278-948a93439656 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:43.748121 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-398464d0-4d92-434a-9278-948a93439656 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:43.748606 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-398464d0-4d92-434a-9278-948a93439656 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:43.958987 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-398464d0-4d92-434a-9278-948a93439656 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:43.966979 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-398464d0-4d92-434a-9278-948a93439656 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.232541 May 16 15:18:43.967677 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 201/411] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:43 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:44.066964 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-21d03029-b5ee-4c5d-8a5f-e00baed57861 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:44.067810 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-21d03029-b5ee-4c5d-8a5f-e00baed57861 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:44.075152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-21d03029-b5ee-4c5d-8a5f-e00baed57861 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:44.075602 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-21d03029-b5ee-4c5d-8a5f-e00baed57861 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:44.078523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-21d03029-b5ee-4c5d-8a5f-e00baed57861 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:44.078523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-21d03029-b5ee-4c5d-8a5f-e00baed57861 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:44.163172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-21d03029-b5ee-4c5d-8a5f-e00baed57861 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:44.170983 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-21d03029-b5ee-4c5d-8a5f-e00baed57861 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1311 microversion: 2.1 time: 0.108449 May 16 15:18:44.171537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 211/412] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:44 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:44.986419 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0184b98c-0b4e-4ad4-a371-abae5cdbbe8b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:44.989153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0184b98c-0b4e-4ad4-a371-abae5cdbbe8b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:44.998190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0184b98c-0b4e-4ad4-a371-abae5cdbbe8b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:44.998761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0184b98c-0b4e-4ad4-a371-abae5cdbbe8b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:44.999602 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0184b98c-0b4e-4ad4-a371-abae5cdbbe8b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:45.000076 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0184b98c-0b4e-4ad4-a371-abae5cdbbe8b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:45.188951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-adc4fb7d-4509-4fef-a1ec-f3f572f57eb0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:45.189535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-adc4fb7d-4509-4fef-a1ec-f3f572f57eb0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:45.197858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adc4fb7d-4509-4fef-a1ec-f3f572f57eb0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:45.198304 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adc4fb7d-4509-4fef-a1ec-f3f572f57eb0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:45.199073 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adc4fb7d-4509-4fef-a1ec-f3f572f57eb0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:45.199498 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adc4fb7d-4509-4fef-a1ec-f3f572f57eb0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:45.231682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0184b98c-0b4e-4ad4-a371-abae5cdbbe8b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:45.241301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0184b98c-0b4e-4ad4-a371-abae5cdbbe8b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.259246 May 16 15:18:45.242144 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 202/413] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:44 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:45.400581 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-adc4fb7d-4509-4fef-a1ec-f3f572f57eb0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:45.413246 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-adc4fb7d-4509-4fef-a1ec-f3f572f57eb0 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1367 microversion: 2.1 time: 0.229366 May 16 15:18:45.413828 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 212/414] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:45 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:45.768065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-09f56a1a-5dbe-4dbf-953e-fc0a16826864 req-037eaa36-b854-4172-9996-68292ac57608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13d168b-75a6-49ab-a169-a941b031915a", "tag": "b8ba8a30-4e6a-49c8-9ac0-4617f3c6e507"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:45.778369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-09f56a1a-5dbe-4dbf-953e-fc0a16826864 req-037eaa36-b854-4172-9996-68292ac57608 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:45.779006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-09f56a1a-5dbe-4dbf-953e-fc0a16826864 req-037eaa36-b854-4172-9996-68292ac57608 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:45.792656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-09f56a1a-5dbe-4dbf-953e-fc0a16826864 req-037eaa36-b854-4172-9996-68292ac57608 service nova] Creating event network-changed:b8ba8a30-4e6a-49c8-9ac0-4617f3c6e507 for instance e13d168b-75a6-49ab-a169-a941b031915a on hv-cinder-84175 May 16 15:18:45.798775 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-09f56a1a-5dbe-4dbf-953e-fc0a16826864 req-037eaa36-b854-4172-9996-68292ac57608 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035890 May 16 15:18:45.801529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 203/415] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:46.262510 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3ad71c44-8058-4791-b2c1-0c7bbdac4c22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:46.263129 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3ad71c44-8058-4791-b2c1-0c7bbdac4c22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:46.270879 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3ad71c44-8058-4791-b2c1-0c7bbdac4c22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:46.271590 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3ad71c44-8058-4791-b2c1-0c7bbdac4c22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:46.272416 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3ad71c44-8058-4791-b2c1-0c7bbdac4c22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:46.272858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3ad71c44-8058-4791-b2c1-0c7bbdac4c22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:46.431381 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c4851fe4-94c9-451e-be36-183cfdf921a3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:46.432008 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c4851fe4-94c9-451e-be36-183cfdf921a3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:46.438557 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c4851fe4-94c9-451e-be36-183cfdf921a3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:46.438998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c4851fe4-94c9-451e-be36-183cfdf921a3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:46.439790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c4851fe4-94c9-451e-be36-183cfdf921a3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:46.440220 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c4851fe4-94c9-451e-be36-183cfdf921a3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:46.716785 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c4851fe4-94c9-451e-be36-183cfdf921a3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:46.724070 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3ad71c44-8058-4791-b2c1-0c7bbdac4c22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:46.724377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c4851fe4-94c9-451e-be36-183cfdf921a3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1367 microversion: 2.1 time: 0.297167 May 16 15:18:46.725235 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 204/416] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:46 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:46.732789 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3ad71c44-8058-4791-b2c1-0c7bbdac4c22 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.474127 May 16 15:18:46.733606 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 213/417] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:46 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:47.742049 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e2314071-38e2-4feb-93a8-c71557007e1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:47.742653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e2314071-38e2-4feb-93a8-c71557007e1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:47.748993 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e2314071-38e2-4feb-93a8-c71557007e1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:47.749434 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e2314071-38e2-4feb-93a8-c71557007e1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:47.750027 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b0a0ba92-8cd4-426b-abd7-9d1853bce7df tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:47.750461 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e2314071-38e2-4feb-93a8-c71557007e1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:47.750602 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e2314071-38e2-4feb-93a8-c71557007e1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:47.750712 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b0a0ba92-8cd4-426b-abd7-9d1853bce7df tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:47.757137 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b0a0ba92-8cd4-426b-abd7-9d1853bce7df tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:47.757582 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b0a0ba92-8cd4-426b-abd7-9d1853bce7df tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:47.758355 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b0a0ba92-8cd4-426b-abd7-9d1853bce7df tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:47.758796 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b0a0ba92-8cd4-426b-abd7-9d1853bce7df tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:47.939980 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e2314071-38e2-4feb-93a8-c71557007e1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:47.943342 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b0a0ba92-8cd4-426b-abd7-9d1853bce7df tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:47.947679 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e2314071-38e2-4feb-93a8-c71557007e1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1367 microversion: 2.1 time: 0.210062 May 16 15:18:47.948555 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 205/418] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:47 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:47.952050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b0a0ba92-8cd4-426b-abd7-9d1853bce7df tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.205814 May 16 15:18:47.952609 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 214/419] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:47 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:48.646340 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ce6433fe-a4c8-49f3-a7cc-d3a6ec87984a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:48.646756 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ce6433fe-a4c8-49f3-a7cc-d3a6ec87984a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:48.653045 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ce6433fe-a4c8-49f3-a7cc-d3a6ec87984a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:48.653497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ce6433fe-a4c8-49f3-a7cc-d3a6ec87984a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:48.654284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ce6433fe-a4c8-49f3-a7cc-d3a6ec87984a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:48.654722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ce6433fe-a4c8-49f3-a7cc-d3a6ec87984a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:48.779173 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-ce6433fe-a4c8-49f3-a7cc-d3a6ec87984a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lazy-loading 'services' on Instance uuid ccced799-d35d-4fcc-81d1-df03942c2394 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:18:48.965755 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-647a96a7-edff-4d85-8fde-eee70696b00d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:48.966846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-647a96a7-edff-4d85-8fde-eee70696b00d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:48.974076 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-647a96a7-edff-4d85-8fde-eee70696b00d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:48.974514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-647a96a7-edff-4d85-8fde-eee70696b00d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:48.975277 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-647a96a7-edff-4d85-8fde-eee70696b00d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:48.975744 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-647a96a7-edff-4d85-8fde-eee70696b00d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:49.015668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ce6433fe-a4c8-49f3-a7cc-d3a6ec87984a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/os-volume_attachments/db4a85aa-8a74-4651-87c8-4ee202d2e4af" status: 202 len: 0 microversion: 2.1 time: 0.374160 May 16 15:18:49.016609 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 206/420] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:18:48 2022] DELETE /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/os-volume_attachments/db4a85aa-8a74-4651-87c8-4ee202d2e4af => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:49.023783 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-496446df-4352-4f8a-9fc3-78dba15cf4b2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:49.024378 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-496446df-4352-4f8a-9fc3-78dba15cf4b2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:49.033325 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-496446df-4352-4f8a-9fc3-78dba15cf4b2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:49.033968 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-496446df-4352-4f8a-9fc3-78dba15cf4b2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:49.035612 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-496446df-4352-4f8a-9fc3-78dba15cf4b2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:49.036219 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-496446df-4352-4f8a-9fc3-78dba15cf4b2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:49.201386 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-647a96a7-edff-4d85-8fde-eee70696b00d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:49.209181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-647a96a7-edff-4d85-8fde-eee70696b00d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1367 microversion: 2.1 time: 0.247919 May 16 15:18:49.209736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 215/421] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:48 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:49.223258 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-496446df-4352-4f8a-9fc3-78dba15cf4b2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:49.231271 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-496446df-4352-4f8a-9fc3-78dba15cf4b2 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.213171 May 16 15:18:49.231876 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 207/422] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:49 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:50.226133 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c143a033-be73-4f79-8f25-7f097330055b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:50.226763 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c143a033-be73-4f79-8f25-7f097330055b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:50.233155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c143a033-be73-4f79-8f25-7f097330055b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:50.233602 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c143a033-be73-4f79-8f25-7f097330055b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:50.234525 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c143a033-be73-4f79-8f25-7f097330055b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:50.234956 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c143a033-be73-4f79-8f25-7f097330055b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:50.249038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7e657d2b-c7e7-4a46-804d-601f8346e9e5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:50.252193 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7e657d2b-c7e7-4a46-804d-601f8346e9e5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:50.256964 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7e657d2b-c7e7-4a46-804d-601f8346e9e5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:50.257536 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7e657d2b-c7e7-4a46-804d-601f8346e9e5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:50.258174 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7e657d2b-c7e7-4a46-804d-601f8346e9e5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:50.258603 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7e657d2b-c7e7-4a46-804d-601f8346e9e5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:50.436004 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c143a033-be73-4f79-8f25-7f097330055b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:50.439657 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7e657d2b-c7e7-4a46-804d-601f8346e9e5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:50.444029 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c143a033-be73-4f79-8f25-7f097330055b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1367 microversion: 2.1 time: 0.221786 May 16 15:18:50.444604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 216/423] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:50 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:50.448247 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7e657d2b-c7e7-4a46-804d-601f8346e9e5 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1735 microversion: 2.1 time: 0.203021 May 16 15:18:50.449117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-2b8b6752-abee-46c9-aaae-2364fb5fd6fc req-3e1c1793-5bfa-4fd4-bb28-570df48af26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13d168b-75a6-49ab-a169-a941b031915a", "name": "network-vif-plugged", "status": "completed", "tag": "b8ba8a30-4e6a-49c8-9ac0-4617f3c6e507"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:50.449281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 208/424] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:50 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:50.457184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2b8b6752-abee-46c9-aaae-2364fb5fd6fc req-3e1c1793-5bfa-4fd4-bb28-570df48af26a service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:50.457633 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2b8b6752-abee-46c9-aaae-2364fb5fd6fc req-3e1c1793-5bfa-4fd4-bb28-570df48af26a service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:50.468278 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-2b8b6752-abee-46c9-aaae-2364fb5fd6fc req-3e1c1793-5bfa-4fd4-bb28-570df48af26a service nova] Creating event network-vif-plugged:b8ba8a30-4e6a-49c8-9ac0-4617f3c6e507 for instance e13d168b-75a6-49ab-a169-a941b031915a on hv-cinder-84175 May 16 15:18:50.473231 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-2b8b6752-abee-46c9-aaae-2364fb5fd6fc req-3e1c1793-5bfa-4fd4-bb28-570df48af26a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027545 May 16 15:18:50.473802 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 217/425] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:51.189987 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-12ed10cc-34ac-400b-87f3-a2b95f89e94c tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:51.196943 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12ed10cc-34ac-400b-87f3-a2b95f89e94c tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.197389 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12ed10cc-34ac-400b-87f3-a2b95f89e94c tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.256656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-12ed10cc-34ac-400b-87f3-a2b95f89e94c tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Going to try to stop instance {{(pid=117677) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 15:18:51.447963 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-12ed10cc-34ac-400b-87f3-a2b95f89e94c tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/action" status: 202 len: 0 microversion: 2.1 time: 0.261636 May 16 15:18:51.448576 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 209/426] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:18:51 2022] POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:51.463123 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-867ee44a-9bb2-416a-bbe1-000e2b927023 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:51.463968 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-867ee44a-9bb2-416a-bbe1-000e2b927023 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:51.465684 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-14fa6b41-4beb-4ade-8f03-59cc4dfd650b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:51.466381 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-14fa6b41-4beb-4ade-8f03-59cc4dfd650b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:51.470151 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-867ee44a-9bb2-416a-bbe1-000e2b927023 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.470598 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-867ee44a-9bb2-416a-bbe1-000e2b927023 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.471360 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-867ee44a-9bb2-416a-bbe1-000e2b927023 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.471820 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-867ee44a-9bb2-416a-bbe1-000e2b927023 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.473015 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-14fa6b41-4beb-4ade-8f03-59cc4dfd650b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.473728 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-14fa6b41-4beb-4ade-8f03-59cc4dfd650b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.474225 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-14fa6b41-4beb-4ade-8f03-59cc4dfd650b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.474663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-14fa6b41-4beb-4ade-8f03-59cc4dfd650b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.733265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-867ee44a-9bb2-416a-bbe1-000e2b927023 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:51.737480 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-14fa6b41-4beb-4ade-8f03-59cc4dfd650b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:51.741665 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-867ee44a-9bb2-416a-bbe1-000e2b927023 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.283155 May 16 15:18:51.742240 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 218/427] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:51 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:51.751997 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-14fa6b41-4beb-4ade-8f03-59cc4dfd650b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1715 microversion: 2.1 time: 0.283799 May 16 15:18:51.751997 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 210/428] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:51 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1715 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:51.752187 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-82b46fa6-7254-4612-b445-a2d6e6b0851d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:51.752187 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-82b46fa6-7254-4612-b445-a2d6e6b0851d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:51.753302 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-82b46fa6-7254-4612-b445-a2d6e6b0851d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.753811 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-82b46fa6-7254-4612-b445-a2d6e6b0851d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.754579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-82b46fa6-7254-4612-b445-a2d6e6b0851d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.755014 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-82b46fa6-7254-4612-b445-a2d6e6b0851d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.853680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:51.854184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:51.860362 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.860814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.861587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.862027 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.890753 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-82b46fa6-7254-4612-b445-a2d6e6b0851d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:51.898981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-82b46fa6-7254-4612-b445-a2d6e6b0851d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1367 microversion: 2.1 time: 0.155704 May 16 15:18:51.899775 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 219/429] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:51 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:51.947287 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] HTTP exception thrown: Cannot 'detach_volume' instance 4d612141-6fe0-4d49-b1aa-071acc497104 while it is in vm_state rescued May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Request method failure captured: May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: DELETE /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments/bbd2d581-9989-4032-ac4c-7dc81a16966f HTTP/1.1 May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqGYNjACNTPuCxQ5tAZjCeNsclj3zBLZYCT0GzhAYLlpUn7x7SwrEZyHipo_-S1Q3XoVpY2bMG8R1hUmX1nlVK9ChFgSDPfiZHV59Z455s8uTYO82BgZA5rt6rI8q4vWGnMjFPQikO1qUS6XBYaU0uepOS4NRKl-OUss-l4Cc_aveg May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:18:51.948917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}] May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 97021ddaffff4e088961ba1873a8e697 May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:18:51.950450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Cannot 'detach_volume' instance 4d612141-6fe0-4d49-b1aa-071acc497104 while it is in vm_state rescued May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'server_id': '4d612141-6fe0-4d49-b1aa-071acc497104', 'id': 'bbd2d581-9989-4032-ac4c-7dc81a16966f'} May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4d612141-6fe0-4d49-b1aa-071acc497104 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:18:51.951292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4d612141-6fe0-4d49-b1aa-071acc497104 while it is in vm_state rescued May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4d612141-6fe0-4d49-b1aa-071acc497104 while it is in vm_state rescued May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:18:51.952762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Returning 409 to user: Cannot 'detach_volume' instance 4d612141-6fe0-4d49-b1aa-071acc497104 while it is in vm_state rescued {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:18:51.953959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-78cd4ba3-8a64-4af2-b3af-158993743f55 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "DELETE /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments/bbd2d581-9989-4032-ac4c-7dc81a16966f" status: 409 len: 152 microversion: 2.1 time: 0.102412 May 16 15:18:51.953959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 211/430] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:18:51 2022] DELETE /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments/bbd2d581-9989-4032-ac4c-7dc81a16966f => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 15:18:51.959639 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dd7f30e5-d4d2-474f-8e62-14c0c2517561 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:51.960194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dd7f30e5-d4d2-474f-8e62-14c0c2517561 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:51.966031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dd7f30e5-d4d2-474f-8e62-14c0c2517561 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.966477 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dd7f30e5-d4d2-474f-8e62-14c0c2517561 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.967228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dd7f30e5-d4d2-474f-8e62-14c0c2517561 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.968113 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dd7f30e5-d4d2-474f-8e62-14c0c2517561 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.163621 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dd7f30e5-d4d2-474f-8e62-14c0c2517561 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "POST /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/action" status: 202 len: 0 microversion: 2.1 time: 0.208001 May 16 15:18:52.164214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 220/431] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:18:51 2022] POST /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:52.172122 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ce9bd3c1-fb8a-4806-ab60-81d4b200b4a7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:52.172734 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ce9bd3c1-fb8a-4806-ab60-81d4b200b4a7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:52.179425 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3c1-fb8a-4806-ab60-81d4b200b4a7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:52.179901 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3c1-fb8a-4806-ab60-81d4b200b4a7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.180663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3c1-fb8a-4806-ab60-81d4b200b4a7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:52.181095 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3c1-fb8a-4806-ab60-81d4b200b4a7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.307525 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ce9bd3c1-fb8a-4806-ab60-81d4b200b4a7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:52.315388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ce9bd3c1-fb8a-4806-ab60-81d4b200b4a7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1723 microversion: 2.1 time: 0.147008 May 16 15:18:52.318035 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 212/432] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:52 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:52.759539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8a7a31e9-7ee2-4c46-b2f3-2e4143b672ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:52.760258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8a7a31e9-7ee2-4c46-b2f3-2e4143b672ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:52.768457 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8a7a31e9-7ee2-4c46-b2f3-2e4143b672ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:52.768914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8a7a31e9-7ee2-4c46-b2f3-2e4143b672ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.770243 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8a7a31e9-7ee2-4c46-b2f3-2e4143b672ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:52.770675 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8a7a31e9-7ee2-4c46-b2f3-2e4143b672ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.915955 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0f8967a5-4036-4f75-bc20-60e1a2aadd61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:52.916573 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0f8967a5-4036-4f75-bc20-60e1a2aadd61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:52.922710 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0f8967a5-4036-4f75-bc20-60e1a2aadd61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:52.923171 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0f8967a5-4036-4f75-bc20-60e1a2aadd61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.923973 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0f8967a5-4036-4f75-bc20-60e1a2aadd61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:52.924415 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0f8967a5-4036-4f75-bc20-60e1a2aadd61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.983276 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8a7a31e9-7ee2-4c46-b2f3-2e4143b672ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:52.990923 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8a7a31e9-7ee2-4c46-b2f3-2e4143b672ff tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.235464 May 16 15:18:52.991480 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 221/433] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:52 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:53.077744 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0f8967a5-4036-4f75-bc20-60e1a2aadd61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:53.085917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0f8967a5-4036-4f75-bc20-60e1a2aadd61 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1367 microversion: 2.1 time: 0.173868 May 16 15:18:53.086485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 213/434] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:52 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:53.333777 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-696b5ba2-6516-46a2-a502-ea2746308899 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:53.334315 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-696b5ba2-6516-46a2-a502-ea2746308899 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:53.340371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-696b5ba2-6516-46a2-a502-ea2746308899 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:53.340827 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-696b5ba2-6516-46a2-a502-ea2746308899 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:53.341599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-696b5ba2-6516-46a2-a502-ea2746308899 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:53.342038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-696b5ba2-6516-46a2-a502-ea2746308899 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:53.466527 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-696b5ba2-6516-46a2-a502-ea2746308899 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:53.474760 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-696b5ba2-6516-46a2-a502-ea2746308899 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1723 microversion: 2.1 time: 0.144901 May 16 15:18:53.475316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 222/435] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:53 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:54.008254 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-27dd8e23-edbd-4577-a7ac-5d5ba06a55ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:54.008794 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-27dd8e23-edbd-4577-a7ac-5d5ba06a55ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:54.015206 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27dd8e23-edbd-4577-a7ac-5d5ba06a55ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.015675 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27dd8e23-edbd-4577-a7ac-5d5ba06a55ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.016452 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27dd8e23-edbd-4577-a7ac-5d5ba06a55ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.016886 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27dd8e23-edbd-4577-a7ac-5d5ba06a55ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.102804 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8ca9671a-abdc-4962-bc8a-892a62d5e1ca tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:54.104164 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8ca9671a-abdc-4962-bc8a-892a62d5e1ca tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:54.111443 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8ca9671a-abdc-4962-bc8a-892a62d5e1ca tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.112002 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8ca9671a-abdc-4962-bc8a-892a62d5e1ca tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.112782 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8ca9671a-abdc-4962-bc8a-892a62d5e1ca tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.113763 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8ca9671a-abdc-4962-bc8a-892a62d5e1ca tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.167081 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-27dd8e23-edbd-4577-a7ac-5d5ba06a55ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:54.174477 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-27dd8e23-edbd-4577-a7ac-5d5ba06a55ab tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.170777 May 16 15:18:54.175051 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 214/436] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:54 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:54.247239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8ca9671a-abdc-4962-bc8a-892a62d5e1ca tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:54.254562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8ca9671a-abdc-4962-bc8a-892a62d5e1ca tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1557 microversion: 2.1 time: 0.155488 May 16 15:18:54.255310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 223/437] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:54 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:54.271363 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f931ef69-4bbb-46b9-ae0f-9ab69d2ef827 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:54.271810 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f931ef69-4bbb-46b9-ae0f-9ab69d2ef827 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:54.277660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f931ef69-4bbb-46b9-ae0f-9ab69d2ef827 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.278107 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f931ef69-4bbb-46b9-ae0f-9ab69d2ef827 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.278872 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f931ef69-4bbb-46b9-ae0f-9ab69d2ef827 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.279305 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f931ef69-4bbb-46b9-ae0f-9ab69d2ef827 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.356278 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f931ef69-4bbb-46b9-ae0f-9ab69d2ef827 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089457 May 16 15:18:54.356874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 215/438] 10.222.0.71 () {58 vars in 1274 bytes} [Mon May 16 15:18:54 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:54.492568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c5273940-7f5d-46ed-b2a9-02e73e5c7584 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:54.493211 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c5273940-7f5d-46ed-b2a9-02e73e5c7584 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:54.498930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c5273940-7f5d-46ed-b2a9-02e73e5c7584 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.499380 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c5273940-7f5d-46ed-b2a9-02e73e5c7584 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.500173 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c5273940-7f5d-46ed-b2a9-02e73e5c7584 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.500613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c5273940-7f5d-46ed-b2a9-02e73e5c7584 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.745823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c5273940-7f5d-46ed-b2a9-02e73e5c7584 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:54.753452 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c5273940-7f5d-46ed-b2a9-02e73e5c7584 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1723 microversion: 2.1 time: 0.264970 May 16 15:18:54.754590 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 224/439] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:54 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:55.193290 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8b526e81-4dee-4fe1-9e0e-4b1e5b070c8f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:55.193819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8b526e81-4dee-4fe1-9e0e-4b1e5b070c8f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:55.199588 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8b526e81-4dee-4fe1-9e0e-4b1e5b070c8f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.200066 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8b526e81-4dee-4fe1-9e0e-4b1e5b070c8f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.200846 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8b526e81-4dee-4fe1-9e0e-4b1e5b070c8f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.201278 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8b526e81-4dee-4fe1-9e0e-4b1e5b070c8f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.664179 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-8b526e81-4dee-4fe1-9e0e-4b1e5b070c8f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:55.672994 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8b526e81-4dee-4fe1-9e0e-4b1e5b070c8f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.485041 May 16 15:18:55.673779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 216/440] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:55 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:55.678013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-d8226740-37b9-4925-827a-47d2d6e366b2 req-b6217e43-3ee2-404c-a703-a948748d1517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13d168b-75a6-49ab-a169-a941b031915a", "tag": "b8ba8a30-4e6a-49c8-9ac0-4617f3c6e507"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:55.687444 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-d8226740-37b9-4925-827a-47d2d6e366b2 req-b6217e43-3ee2-404c-a703-a948748d1517 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.687987 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-d8226740-37b9-4925-827a-47d2d6e366b2 req-b6217e43-3ee2-404c-a703-a948748d1517 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.700499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-d8226740-37b9-4925-827a-47d2d6e366b2 req-b6217e43-3ee2-404c-a703-a948748d1517 service nova] Creating event network-changed:b8ba8a30-4e6a-49c8-9ac0-4617f3c6e507 for instance e13d168b-75a6-49ab-a169-a941b031915a on hv-cinder-84175 May 16 15:18:55.709516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-d8226740-37b9-4925-827a-47d2d6e366b2 req-b6217e43-3ee2-404c-a703-a948748d1517 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036246 May 16 15:18:55.710417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 225/441] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:55.772309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3b023ca4-f219-4a8d-8794-ca08c86338a8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:55.772929 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3b023ca4-f219-4a8d-8794-ca08c86338a8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:55.779494 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3b023ca4-f219-4a8d-8794-ca08c86338a8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.779983 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3b023ca4-f219-4a8d-8794-ca08c86338a8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.780786 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3b023ca4-f219-4a8d-8794-ca08c86338a8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.781232 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3b023ca4-f219-4a8d-8794-ca08c86338a8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.928614 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3b023ca4-f219-4a8d-8794-ca08c86338a8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:55.937182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3b023ca4-f219-4a8d-8794-ca08c86338a8 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1723 microversion: 2.1 time: 0.169704 May 16 15:18:55.937763 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 217/442] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:55 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:56.691365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2db1605a-6674-4d02-b780-d5c911ef7595 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:56.692156 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2db1605a-6674-4d02-b780-d5c911ef7595 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:56.698269 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2db1605a-6674-4d02-b780-d5c911ef7595 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:56.698829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2db1605a-6674-4d02-b780-d5c911ef7595 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:56.699783 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2db1605a-6674-4d02-b780-d5c911ef7595 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:56.700317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2db1605a-6674-4d02-b780-d5c911ef7595 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:56.909526 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2db1605a-6674-4d02-b780-d5c911ef7595 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:56.917734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2db1605a-6674-4d02-b780-d5c911ef7595 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.231170 May 16 15:18:56.918300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 226/443] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:56 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:56.954280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5049365e-2577-40cb-89ce-98fbe34c9ede tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:56.954989 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5049365e-2577-40cb-89ce-98fbe34c9ede tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:56.961715 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5049365e-2577-40cb-89ce-98fbe34c9ede tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:56.962161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5049365e-2577-40cb-89ce-98fbe34c9ede tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:56.962919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5049365e-2577-40cb-89ce-98fbe34c9ede tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:56.963350 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5049365e-2577-40cb-89ce-98fbe34c9ede tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:57.093034 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5049365e-2577-40cb-89ce-98fbe34c9ede tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:57.101636 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5049365e-2577-40cb-89ce-98fbe34c9ede tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1729 microversion: 2.1 time: 0.151189 May 16 15:18:57.102194 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 218/444] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:56 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:57.118298 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f20efcfc-0925-402d-b490-9b0ce9673881 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:57.118795 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f20efcfc-0925-402d-b490-9b0ce9673881 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:57.124601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f20efcfc-0925-402d-b490-9b0ce9673881 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:57.125054 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f20efcfc-0925-402d-b490-9b0ce9673881 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:57.125820 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f20efcfc-0925-402d-b490-9b0ce9673881 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:57.126260 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f20efcfc-0925-402d-b490-9b0ce9673881 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:57.200133 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f20efcfc-0925-402d-b490-9b0ce9673881 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.085516 May 16 15:18:57.200738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 227/445] 10.222.0.71 () {58 vars in 1274 bytes} [Mon May 16 15:18:57 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-interface => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:57.935310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-57529e86-9efd-4758-9574-d15bb8ac2722 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:57.936045 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-57529e86-9efd-4758-9574-d15bb8ac2722 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:57.942559 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-57529e86-9efd-4758-9574-d15bb8ac2722 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:57.943016 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-57529e86-9efd-4758-9574-d15bb8ac2722 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:57.943820 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-57529e86-9efd-4758-9574-d15bb8ac2722 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:57.944285 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-57529e86-9efd-4758-9574-d15bb8ac2722 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.146255 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-57529e86-9efd-4758-9574-d15bb8ac2722 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:58.153710 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-57529e86-9efd-4758-9574-d15bb8ac2722 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.222323 May 16 15:18:58.154289 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 219/446] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:57 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:58.203975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-2b589c87-0202-4819-bb9e-f615e4706a8c req-74ba1c46-631d-46ff-ac1d-9988eeebce1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d612141-6fe0-4d49-b1aa-071acc497104", "tag": "75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:58.211931 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2b589c87-0202-4819-bb9e-f615e4706a8c req-74ba1c46-631d-46ff-ac1d-9988eeebce1c service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.212375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-2b589c87-0202-4819-bb9e-f615e4706a8c req-74ba1c46-631d-46ff-ac1d-9988eeebce1c service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.223849 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-2b589c87-0202-4819-bb9e-f615e4706a8c req-74ba1c46-631d-46ff-ac1d-9988eeebce1c service nova] Creating event network-changed:75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b for instance 4d612141-6fe0-4d49-b1aa-071acc497104 on hv-cinder-84175 May 16 15:18:58.228762 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-2b589c87-0202-4819-bb9e-f615e4706a8c req-74ba1c46-631d-46ff-ac1d-9988eeebce1c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028872 May 16 15:18:58.229369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 228/447] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:59.171810 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-301faf8f-cc8d-42e9-a0a1-7532166004e6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:59.172319 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-301faf8f-cc8d-42e9-a0a1-7532166004e6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:59.179344 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-301faf8f-cc8d-42e9-a0a1-7532166004e6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:59.179823 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-301faf8f-cc8d-42e9-a0a1-7532166004e6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:59.180587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-301faf8f-cc8d-42e9-a0a1-7532166004e6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:59.181020 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-301faf8f-cc8d-42e9-a0a1-7532166004e6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:59.306937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-301faf8f-cc8d-42e9-a0a1-7532166004e6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:59.314174 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-301faf8f-cc8d-42e9-a0a1-7532166004e6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.146428 May 16 15:18:59.314743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 220/448] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:18:59 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:00.243413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-11dd0bc6-5376-4d0e-bf24-991808359316 req-fe76a2f1-68ab-4d80-b300-ad5a41ea3bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d612141-6fe0-4d49-b1aa-071acc497104", "tag": "75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:00.251575 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-11dd0bc6-5376-4d0e-bf24-991808359316 req-fe76a2f1-68ab-4d80-b300-ad5a41ea3bc6 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.252041 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-11dd0bc6-5376-4d0e-bf24-991808359316 req-fe76a2f1-68ab-4d80-b300-ad5a41ea3bc6 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.262434 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-11dd0bc6-5376-4d0e-bf24-991808359316 req-fe76a2f1-68ab-4d80-b300-ad5a41ea3bc6 service nova] Creating event network-changed:75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b for instance 4d612141-6fe0-4d49-b1aa-071acc497104 on hv-cinder-84175 May 16 15:19:00.267288 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-11dd0bc6-5376-4d0e-bf24-991808359316 req-fe76a2f1-68ab-4d80-b300-ad5a41ea3bc6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028520 May 16 15:19:00.268119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 229/449] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:00.331314 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e836071c-d30c-4fc4-9836-786d6fba340a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:00.332737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e836071c-d30c-4fc4-9836-786d6fba340a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:00.339429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e836071c-d30c-4fc4-9836-786d6fba340a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.339961 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e836071c-d30c-4fc4-9836-786d6fba340a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.340733 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e836071c-d30c-4fc4-9836-786d6fba340a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.341160 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e836071c-d30c-4fc4-9836-786d6fba340a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.570510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e836071c-d30c-4fc4-9836-786d6fba340a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:00.577766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e836071c-d30c-4fc4-9836-786d6fba340a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.250232 May 16 15:19:00.578341 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 221/450] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:00 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:01.109178 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-13989b9a-4461-48c1-9569-d38263248e3c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:01.109691 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-13989b9a-4461-48c1-9569-d38263248e3c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:01.116271 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-13989b9a-4461-48c1-9569-d38263248e3c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.116722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-13989b9a-4461-48c1-9569-d38263248e3c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.117480 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-13989b9a-4461-48c1-9569-d38263248e3c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.117909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-13989b9a-4461-48c1-9569-d38263248e3c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.146432 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-13989b9a-4461-48c1-9569-d38263248e3c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments/6e538de2-13c4-488f-953a-8383f102b83f" status: 200 len: 194 microversion: 2.20 time: 0.041402 May 16 15:19:01.147001 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 230/451] 10.222.0.71 () {60 vars in 1453 bytes} [Mon May 16 15:19:01 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments/6e538de2-13c4-488f-953a-8383f102b83f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:19:01.206182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-325604d1-09ba-4ac6-8346-0653a11d857c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:01.207375 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-325604d1-09ba-4ac6-8346-0653a11d857c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:01.213437 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-325604d1-09ba-4ac6-8346-0653a11d857c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.213884 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-325604d1-09ba-4ac6-8346-0653a11d857c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.214639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-325604d1-09ba-4ac6-8346-0653a11d857c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.215067 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-325604d1-09ba-4ac6-8346-0653a11d857c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.295622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-325604d1-09ba-4ac6-8346-0653a11d857c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lazy-loading 'services' on Instance uuid 893feede-4052-4c51-96a2-1f93510d1f5f {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:01.520842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-325604d1-09ba-4ac6-8346-0653a11d857c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "DELETE /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments/6e538de2-13c4-488f-953a-8383f102b83f" status: 202 len: 0 microversion: 2.20 time: 0.318607 May 16 15:19:01.522157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 222/452] 10.222.0.71 () {60 vars in 1456 bytes} [Mon May 16 15:19:01 2022] DELETE /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments/6e538de2-13c4-488f-953a-8383f102b83f => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:19:01.530294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-12f7b243-0cbd-4e67-9979-a5e0d1439952 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:01.531282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-12f7b243-0cbd-4e67-9979-a5e0d1439952 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:01.538098 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-12f7b243-0cbd-4e67-9979-a5e0d1439952 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.538557 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-12f7b243-0cbd-4e67-9979-a5e0d1439952 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.539340 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-12f7b243-0cbd-4e67-9979-a5e0d1439952 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.539829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-12f7b243-0cbd-4e67-9979-a5e0d1439952 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.569642 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-12f7b243-0cbd-4e67-9979-a5e0d1439952 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043380 May 16 15:19:01.570205 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 231/453] 10.222.0.71 () {60 vars in 1342 bytes} [Mon May 16 15:19:01 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:19:01.595731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c10b4c2b-ad1b-4b42-a7e9-2dec09c9f5d4 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:01.596429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c10b4c2b-ad1b-4b42-a7e9-2dec09c9f5d4 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:01.603016 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c10b4c2b-ad1b-4b42-a7e9-2dec09c9f5d4 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.608319 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c10b4c2b-ad1b-4b42-a7e9-2dec09c9f5d4 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.608319 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c10b4c2b-ad1b-4b42-a7e9-2dec09c9f5d4 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.608319 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c10b4c2b-ad1b-4b42-a7e9-2dec09c9f5d4 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.736021 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c10b4c2b-ad1b-4b42-a7e9-2dec09c9f5d4 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:01.743824 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c10b4c2b-ad1b-4b42-a7e9-2dec09c9f5d4 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1679 microversion: 2.1 time: 0.152396 May 16 15:19:01.744418 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 223/454] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:01 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:02.580828 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d31ba140-50ba-4f04-8dfa-29057304be74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:02.582431 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d31ba140-50ba-4f04-8dfa-29057304be74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:02.588926 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d31ba140-50ba-4f04-8dfa-29057304be74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.589378 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d31ba140-50ba-4f04-8dfa-29057304be74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.590148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d31ba140-50ba-4f04-8dfa-29057304be74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.590582 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d31ba140-50ba-4f04-8dfa-29057304be74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.620800 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d31ba140-50ba-4f04-8dfa-29057304be74 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043829 May 16 15:19:02.621278 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 232/455] 10.222.0.71 () {60 vars in 1342 bytes} [Mon May 16 15:19:02 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:19:02.761028 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-24d6e08f-42a2-4126-9307-6e6e5f5e4ca2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:02.761639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-24d6e08f-42a2-4126-9307-6e6e5f5e4ca2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:02.768015 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-24d6e08f-42a2-4126-9307-6e6e5f5e4ca2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.768457 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-24d6e08f-42a2-4126-9307-6e6e5f5e4ca2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.769218 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-24d6e08f-42a2-4126-9307-6e6e5f5e4ca2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.770211 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-24d6e08f-42a2-4126-9307-6e6e5f5e4ca2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.896910 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-24d6e08f-42a2-4126-9307-6e6e5f5e4ca2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:02.904510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-24d6e08f-42a2-4126-9307-6e6e5f5e4ca2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1656 microversion: 2.1 time: 0.147468 May 16 15:19:02.905071 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 224/456] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:02 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:02.921214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5ab6916f-aaf1-43f1-8b0c-1b2e07e40435 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:02.928086 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5ab6916f-aaf1-43f1-8b0c-1b2e07e40435 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.928536 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5ab6916f-aaf1-43f1-8b0c-1b2e07e40435 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.009517 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5ab6916f-aaf1-43f1-8b0c-1b2e07e40435 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Going to try to start instance {{(pid=117676) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 15:19:03.219253 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5ab6916f-aaf1-43f1-8b0c-1b2e07e40435 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/action" status: 202 len: 0 microversion: 2.1 time: 0.301383 May 16 15:19:03.220243 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 233/457] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:19:02 2022] POST /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:03.228384 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-85aaea52-5912-4df7-9c8c-8dc30ef7ea12 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:03.228991 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-85aaea52-5912-4df7-9c8c-8dc30ef7ea12 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:03.234964 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-85aaea52-5912-4df7-9c8c-8dc30ef7ea12 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.238668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-85aaea52-5912-4df7-9c8c-8dc30ef7ea12 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.238668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-85aaea52-5912-4df7-9c8c-8dc30ef7ea12 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.238668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-85aaea52-5912-4df7-9c8c-8dc30ef7ea12 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.370818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-85aaea52-5912-4df7-9c8c-8dc30ef7ea12 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:03.378248 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-85aaea52-5912-4df7-9c8c-8dc30ef7ea12 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1665 microversion: 2.1 time: 0.153739 May 16 15:19:03.378872 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 225/458] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:03 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:03.633555 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-236ba9d9-eea0-422b-89e6-7bfb29ed0a78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:03.634560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-236ba9d9-eea0-422b-89e6-7bfb29ed0a78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:03.641037 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-236ba9d9-eea0-422b-89e6-7bfb29ed0a78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.641490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-236ba9d9-eea0-422b-89e6-7bfb29ed0a78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.642258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-236ba9d9-eea0-422b-89e6-7bfb29ed0a78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.642690 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-236ba9d9-eea0-422b-89e6-7bfb29ed0a78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.672115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-236ba9d9-eea0-422b-89e6-7bfb29ed0a78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043378 May 16 15:19:03.676258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 234/459] 10.222.0.71 () {60 vars in 1342 bytes} [Mon May 16 15:19:03 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:03.733746 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3abcfb17-29a7-4528-b63b-8afc8604c34d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:03.734271 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3abcfb17-29a7-4528-b63b-8afc8604c34d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:03.740800 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3abcfb17-29a7-4528-b63b-8afc8604c34d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.741241 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3abcfb17-29a7-4528-b63b-8afc8604c34d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.742006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3abcfb17-29a7-4528-b63b-8afc8604c34d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.742433 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3abcfb17-29a7-4528-b63b-8afc8604c34d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.767352 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3abcfb17-29a7-4528-b63b-8afc8604c34d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:19:04.024914 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3abcfb17-29a7-4528-b63b-8afc8604c34d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "DELETE /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 204 len: 0 microversion: 2.20 time: 0.294754 May 16 15:19:04.025520 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 226/460] 10.222.0.71 () {60 vars in 1279 bytes} [Mon May 16 15:19:03 2022] DELETE /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:19:04.033647 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:04.037340 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:04.040225 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.040677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.041440 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.041883 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.168928 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:04.177534 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:04.179033 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:04.180221 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b737bd43-fa2b-4fb2-8166-354a6d485a48 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.150507 May 16 15:19:04.180779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 235/461] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:04 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:04.396545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-12a09773-aae7-4512-b091-016f9fa5a8e5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:04.397182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-12a09773-aae7-4512-b091-016f9fa5a8e5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:04.403091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12a09773-aae7-4512-b091-016f9fa5a8e5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.403538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12a09773-aae7-4512-b091-016f9fa5a8e5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.404327 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12a09773-aae7-4512-b091-016f9fa5a8e5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.404756 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12a09773-aae7-4512-b091-016f9fa5a8e5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.532450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-12a09773-aae7-4512-b091-016f9fa5a8e5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:04.539861 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-12a09773-aae7-4512-b091-016f9fa5a8e5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1665 microversion: 2.1 time: 0.147963 May 16 15:19:04.540434 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 227/462] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:04 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:05.199369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:05.200005 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:05.206357 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.206920 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.208316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.208766 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.335732 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:05.343498 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:05.344997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:05.346130 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-51d7a4b2-2e09-4e64-b815-d01330648ffc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.150592 May 16 15:19:05.346676 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 236/463] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:05 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:05.557250 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0a412a78-2bf9-434c-924a-fd6fb0ed1811 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:05.557849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0a412a78-2bf9-434c-924a-fd6fb0ed1811 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:05.564213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a412a78-2bf9-434c-924a-fd6fb0ed1811 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.567083 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a412a78-2bf9-434c-924a-fd6fb0ed1811 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.567083 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a412a78-2bf9-434c-924a-fd6fb0ed1811 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.567083 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a412a78-2bf9-434c-924a-fd6fb0ed1811 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.693082 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0a412a78-2bf9-434c-924a-fd6fb0ed1811 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:05.700529 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0a412a78-2bf9-434c-924a-fd6fb0ed1811 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1665 microversion: 2.1 time: 0.147028 May 16 15:19:05.701100 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 228/464] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:05 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1665 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:06.366177 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:06.366814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:06.373134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.373578 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.374339 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.374770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.590344 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:06.599065 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:06.600798 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:06.601971 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8403fb28-ff6c-422c-b054-e5936ef1cc5e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1723 microversion: 2.20 time: 0.240699 May 16 15:19:06.602544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 237/465] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:06 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:06.718138 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-27bbdf72-cc6a-429a-a01b-9f1f09f44ccf tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:06.718752 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-27bbdf72-cc6a-429a-a01b-9f1f09f44ccf tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:06.726060 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27bbdf72-cc6a-429a-a01b-9f1f09f44ccf tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.726515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27bbdf72-cc6a-429a-a01b-9f1f09f44ccf tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.727287 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27bbdf72-cc6a-429a-a01b-9f1f09f44ccf tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.727756 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27bbdf72-cc6a-429a-a01b-9f1f09f44ccf tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.960130 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-27bbdf72-cc6a-429a-a01b-9f1f09f44ccf tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:06.967523 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-27bbdf72-cc6a-429a-a01b-9f1f09f44ccf tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1669 microversion: 2.1 time: 0.253236 May 16 15:19:06.968118 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 229/466] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:06 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:07.621549 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:07.622058 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:07.628257 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.628714 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.629989 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.630445 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.653567 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-dae3db12-ed04-4fad-9d9d-235d7a013590 req-d9c3a316-bda5-4c19-9017-1f932747b033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893feede-4052-4c51-96a2-1f93510d1f5f", "name": "network-vif-deleted", "tag": "7be8453f-3109-4b92-981a-837b09373d42"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:07.662377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-dae3db12-ed04-4fad-9d9d-235d7a013590 req-d9c3a316-bda5-4c19-9017-1f932747b033 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.662814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-dae3db12-ed04-4fad-9d9d-235d7a013590 req-d9c3a316-bda5-4c19-9017-1f932747b033 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.677198 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-dae3db12-ed04-4fad-9d9d-235d7a013590 req-d9c3a316-bda5-4c19-9017-1f932747b033 service nova] Creating event network-vif-deleted:7be8453f-3109-4b92-981a-837b09373d42 for instance 893feede-4052-4c51-96a2-1f93510d1f5f on hv-cinder-84175 May 16 15:19:07.682572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-dae3db12-ed04-4fad-9d9d-235d7a013590 req-d9c3a316-bda5-4c19-9017-1f932747b033 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032504 May 16 15:19:07.683512 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 230/467] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:07.699686 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:07.708799 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:07.710213 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:07.711454 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b941f64e-f6e8-457e-b56f-0861087a9796 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 200 len: 1655 microversion: 2.20 time: 0.094636 May 16 15:19:07.712041 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 238/468] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:07 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:08.730865 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.731562 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:08.737666 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.738116 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.739739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.740177 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.753068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] HTTP exception thrown: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Request method failure captured: May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f HTTP/1.1 May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqTQgvaFhTvoYDUgHRqRP-poyEsVSsVVthqsruAXPsRz_jXjyy1A1RQxJOtvJURnbZMeeUpqqXVOF5Gl-dK5lhaiER_Vp6m4Xg08uD12ZqI905IYLSbyZmS5HhwqnpaA40YuXgZsTu30RaRh8bEpnfCU_8wuItSQVtffxw0jaTzin4 May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:19:08.754739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}] May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 7b559cc982a846bea7f7f2077b7c455b May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:19:08.758265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '893feede-4052-4c51-96a2-1f93510d1f5f'} May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:08.759184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:19:08.760737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:19:08.762033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Returning 404 to user: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:08.762033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c2ea4649-2ffc-4145-baf1-ebd5e024d51d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 404 len: 111 microversion: 2.20 time: 0.029952 May 16 15:19:08.762033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 231/469] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:08 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:19:08.764713 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-90ffbfd1-b51a-48c7-af28-b0308f42247f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '.version_select at 0x7f0c881268b0>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.862827 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-90ffbfd1-b51a-48c7-af28-b0308f42247f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-758959174" status: 204 len: 0 microversion: 2.20 time: 0.101747 May 16 15:19:08.863429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 239/470] 10.222.0.71 () {60 vars in 1258 bytes} [Mon May 16 15:19:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-758959174 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:19:09.666827 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9086768c-bf8a-49df-9d7a-025af577102b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'create', calling method: .version_select at 0x7f0c8372a670>, body: {"keypair": {"name": "tempest-keypair-797413150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvXGd4lQqyi6Mezhkki3RwQLuAXURKarYgIllMKIS+u2JqEO2IQnqXdLFPt4ydYN7nBZIvAGEzQkRAj8cAQ5WfrNs/mbk43m0i8C23u6Ti/Buzfaw4pH5dlmdiC6VILLA=="}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:09.680782 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-9086768c-bf8a-49df-9d7a-025af577102b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Getting quotas for project 64990eb359b54b0a8636a6e7619800a7. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:09.684426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-9086768c-bf8a-49df-9d7a-025af577102b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Getting quotas for user 7b559cc982a846bea7f7f2077b7c455b and project 64990eb359b54b0a8636a6e7619800a7. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:09.777016 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9086768c-bf8a-49df-9d7a-025af577102b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.114013 May 16 15:19:09.777672 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 232/471] 10.222.0.71 () {62 vars in 1199 bytes} [Mon May 16 15:19:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 15:19:11.856608 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2056300116", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92826b7c-8754-4fc6-b45f-5923507414b1"}], "security_groups": [{"name": "tempest-securitygroup--2033769272"}], "key_name": "tempest-keypair-797413150", "user_data": "}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:11.955245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] validate_networks() for [('92826b7c-8754-4fc6-b45f-5923507414b1', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:19:12.311555 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:19:12.312009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:19:12.312482 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:19:12.312885 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:19:12.313291 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:19:12.321638 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.322079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.322871 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.323297 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.338945 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Getting quotas for project 64990eb359b54b0a8636a6e7619800a7. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:12.342750 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Getting quotas for user 7b559cc982a846bea7f7f2077b7c455b and project 64990eb359b54b0a8636a6e7619800a7. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:12.353903 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:19:12.356128 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:19:12.484191 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5b78f009-25be-41cc-8626-f3a379c54572 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.632549 May 16 15:19:12.484867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 240/472] 10.222.0.71 () {62 vars in 1187 bytes} [Mon May 16 15:19:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 15:19:12.496485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c0b79b82-15d5-4031-a5be-29f118d68180 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:12.497281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c0b79b82-15d5-4031-a5be-29f118d68180 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:12.555248 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c0b79b82-15d5-4031-a5be-29f118d68180 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:12.562247 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c0b79b82-15d5-4031-a5be-29f118d68180 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:12.563760 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c0b79b82-15d5-4031-a5be-29f118d68180 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:12.564865 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c0b79b82-15d5-4031-a5be-29f118d68180 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1281 microversion: 2.20 time: 0.072711 May 16 15:19:12.565404 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 233/473] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:12 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:19:13.584800 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:13.585410 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:13.591596 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.592085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.592842 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.593305 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.656990 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:13.666042 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:13.667567 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:13.668794 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f4b9df64-ee41-435a-8cec-61ba59d558cb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1285 microversion: 2.20 time: 0.088950 May 16 15:19:13.669391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 241/474] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:13 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:14.686472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:14.687057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:14.694964 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.695410 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.696210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.696645 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.758050 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:14.766002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:14.767472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:14.768592 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7eaeab39-1cff-4654-993a-d4efa4ab6958 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1351 microversion: 2.20 time: 0.085977 May 16 15:19:14.769141 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 234/475] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:14 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:15.796205 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:15.796919 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:15.803406 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:15.808147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:15.808147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:15.808147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.034890 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:16.044625 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:16.046116 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:16.047239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-31d4da68-b445-430b-98d6-7829d562df62 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1407 microversion: 2.20 time: 0.254932 May 16 15:19:16.049629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 242/476] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:15 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:16.255680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-a38bf0b5-0883-4436-a6a7-5ee8bcb831a0 req-0d01174c-eb2a-41b9-b208-d7e8a9e7b691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6da10c-c8a8-4a5c-aab9-9a507ef24e67", "tag": "34cd4358-1a24-49da-a7e4-d4b0049ac593"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:16.264744 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-a38bf0b5-0883-4436-a6a7-5ee8bcb831a0 req-0d01174c-eb2a-41b9-b208-d7e8a9e7b691 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.265132 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-a38bf0b5-0883-4436-a6a7-5ee8bcb831a0 req-0d01174c-eb2a-41b9-b208-d7e8a9e7b691 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.277003 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-a38bf0b5-0883-4436-a6a7-5ee8bcb831a0 req-0d01174c-eb2a-41b9-b208-d7e8a9e7b691 service nova] Creating event network-changed:34cd4358-1a24-49da-a7e4-d4b0049ac593 for instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 on hv-cinder-84175 May 16 15:19:16.284092 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-a38bf0b5-0883-4436-a6a7-5ee8bcb831a0 req-0d01174c-eb2a-41b9-b208-d7e8a9e7b691 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032905 May 16 15:19:16.284943 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 235/477] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:17.066208 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:17.066825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:17.073616 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.074078 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.074853 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.075295 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.203583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:17.211825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:17.213300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:17.214394 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dac37b6d-7a5c-4ce4-9392-8329b3548f13 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1407 microversion: 2.20 time: 0.152046 May 16 15:19:17.214944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 243/478] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:17 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:18.233953 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:18.234731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:18.241376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:18.241816 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:18.242598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:18.243027 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:18.371377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:18.379072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:18.381227 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:18.382316 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f5c3229d-7a4f-4841-8247-ea7b78627df8 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1407 microversion: 2.20 time: 0.153001 May 16 15:19:18.382866 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 236/479] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:18 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:19.401091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:19.401735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:19.407995 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.408446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.409204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.409639 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.534541 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:19.542274 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:19.543760 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:19.544846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-963a9a0a-e3ba-4f71-a9f7-76e4a8e56125 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1407 microversion: 2.20 time: 0.147635 May 16 15:19:19.545391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 244/480] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:19 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:20.563127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:20.563764 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:20.570865 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.571310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.572112 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.572575 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.700547 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:20.708987 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:20.710512 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:20.711614 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d754d49b-1589-40bc-ad9d-e317b2a7cbab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1407 microversion: 2.20 time: 0.152319 May 16 15:19:20.712224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 237/481] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:20 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:21.730068 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:21.730713 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:21.737086 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.737530 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.738293 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.738728 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.864167 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:21.872070 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:21.873535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:21.874636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-9941dd84-2adb-4729-84db-982708875ecc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1407 microversion: 2.20 time: 0.148462 May 16 15:19:21.875193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 245/482] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:21 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:22.396463 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-31865fe5-e4ae-43af-8131-0a7f28644047 req-efdb401c-a246-44e5-9d63-e93f564fffaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6da10c-c8a8-4a5c-aab9-9a507ef24e67", "name": "network-vif-plugged", "status": "completed", "tag": "34cd4358-1a24-49da-a7e4-d4b0049ac593"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:22.409358 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-31865fe5-e4ae-43af-8131-0a7f28644047 req-efdb401c-a246-44e5-9d63-e93f564fffaf service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.409358 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-31865fe5-e4ae-43af-8131-0a7f28644047 req-efdb401c-a246-44e5-9d63-e93f564fffaf service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.415807 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-31865fe5-e4ae-43af-8131-0a7f28644047 req-efdb401c-a246-44e5-9d63-e93f564fffaf service nova] Creating event network-vif-plugged:34cd4358-1a24-49da-a7e4-d4b0049ac593 for instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 on hv-cinder-84175 May 16 15:19:22.420624 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-31865fe5-e4ae-43af-8131-0a7f28644047 req-efdb401c-a246-44e5-9d63-e93f564fffaf service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028725 May 16 15:19:22.421197 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 238/483] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:22.891703 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:22.892321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:22.899342 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.899823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.900588 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.901021 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:23.028880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:23.036996 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:23.038620 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:23.039747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f1882e72-b21d-4c37-a63e-6dc19d788973 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1407 microversion: 2.20 time: 0.151886 May 16 15:19:23.040294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 246/484] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:22 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:24.059039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:24.059767 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:24.065880 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:24.066327 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:24.067088 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:24.068302 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:24.193158 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:24.200758 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:24.202228 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:24.203316 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0f657c7c-b33b-4849-9a9d-e0d890860927 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1407 microversion: 2.20 time: 0.149014 May 16 15:19:24.203894 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 239/485] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:24 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:25.220928 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:25.221550 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:25.228171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:25.233971 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:25.233971 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:25.233971 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:25.357576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:25.365422 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:25.370580 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:25.370580 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6c597cb3-2e88-4021-8ddb-be75300d1873 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1599 microversion: 2.20 time: 0.151018 May 16 15:19:25.370580 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 247/486] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:19:25 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:25.385691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a2b74d8f-5daa-4ba6-9c6b-2482cf792ec9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:25.386174 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a2b74d8f-5daa-4ba6-9c6b-2482cf792ec9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:25.392433 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a2b74d8f-5daa-4ba6-9c6b-2482cf792ec9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:25.392880 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a2b74d8f-5daa-4ba6-9c6b-2482cf792ec9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:25.393639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a2b74d8f-5daa-4ba6-9c6b-2482cf792ec9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:25.394075 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a2b74d8f-5daa-4ba6-9c6b-2482cf792ec9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:25.469336 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a2b74d8f-5daa-4ba6-9c6b-2482cf792ec9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087423 May 16 15:19:25.469937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 240/487] 10.222.0.71 () {60 vars in 1315 bytes} [Mon May 16 15:19:25 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:19:26.684828 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-51413ef2-0139-40f8-9fab-fd38086ec2c0 req-2f1cdba5-198b-412d-9481-e2ab6607a0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6da10c-c8a8-4a5c-aab9-9a507ef24e67", "tag": "34cd4358-1a24-49da-a7e4-d4b0049ac593"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:26.693950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-51413ef2-0139-40f8-9fab-fd38086ec2c0 req-2f1cdba5-198b-412d-9481-e2ab6607a0e0 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:26.694402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-51413ef2-0139-40f8-9fab-fd38086ec2c0 req-2f1cdba5-198b-412d-9481-e2ab6607a0e0 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:26.705090 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-51413ef2-0139-40f8-9fab-fd38086ec2c0 req-2f1cdba5-198b-412d-9481-e2ab6607a0e0 service nova] Creating event network-changed:34cd4358-1a24-49da-a7e4-d4b0049ac593 for instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 on hv-cinder-84175 May 16 15:19:26.710170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-51413ef2-0139-40f8-9fab-fd38086ec2c0 req-2f1cdba5-198b-412d-9481-e2ab6607a0e0 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029026 May 16 15:19:26.710752 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 248/488] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:33.426198 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-51bb3e68-f607-4878-8f2b-2e7e169f6686 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:33.426778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-51bb3e68-f607-4878-8f2b-2e7e169f6686 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:33.433324 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-51bb3e68-f607-4878-8f2b-2e7e169f6686 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:33.433779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-51bb3e68-f607-4878-8f2b-2e7e169f6686 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:33.434572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-51bb3e68-f607-4878-8f2b-2e7e169f6686 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:33.435003 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-51bb3e68-f607-4878-8f2b-2e7e169f6686 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:33.457742 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-51bb3e68-f607-4878-8f2b-2e7e169f6686 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/ips" status: 200 len: 149 microversion: 2.1 time: 0.036072 May 16 15:19:33.458375 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 241/489] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:19:33 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:35.135272 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6671293e-23d8-4fe2-ad24-4ce1cc090d48 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9acf630b-d59e-409a-ada6-9b81ca4116c6"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:35.136487 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6671293e-23d8-4fe2-ad24-4ce1cc090d48 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:35.142473 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6671293e-23d8-4fe2-ad24-4ce1cc090d48 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:35.142923 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6671293e-23d8-4fe2-ad24-4ce1cc090d48 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:35.143707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6671293e-23d8-4fe2-ad24-4ce1cc090d48 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:35.144143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6671293e-23d8-4fe2-ad24-4ce1cc090d48 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:35.866071 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6671293e-23d8-4fe2-ad24-4ce1cc090d48 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735458 May 16 15:19:35.866685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 249/490] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:19:35 2022] POST /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:37.162354 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3deb7ca2-ab74-480e-8836-bd2bb62d2a8f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:37.162931 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3deb7ca2-ab74-480e-8836-bd2bb62d2a8f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:37.169108 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3deb7ca2-ab74-480e-8836-bd2bb62d2a8f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:37.169553 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3deb7ca2-ab74-480e-8836-bd2bb62d2a8f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:37.170310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3deb7ca2-ab74-480e-8836-bd2bb62d2a8f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:37.170741 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3deb7ca2-ab74-480e-8836-bd2bb62d2a8f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:37.249201 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-3deb7ca2-ab74-480e-8836-bd2bb62d2a8f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lazy-loading 'services' on Instance uuid 4d612141-6fe0-4d49-b1aa-071acc497104 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:37.464617 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3deb7ca2-ab74-480e-8836-bd2bb62d2a8f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "DELETE /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments/bbd2d581-9989-4032-ac4c-7dc81a16966f" status: 202 len: 0 microversion: 2.1 time: 0.306445 May 16 15:19:37.465147 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 242/491] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:19:37 2022] DELETE /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments/bbd2d581-9989-4032-ac4c-7dc81a16966f => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:37.474349 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-41abff9f-e8c6-4d43-bd9d-c9b779e741ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:37.478226 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-41abff9f-e8c6-4d43-bd9d-c9b779e741ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:37.482325 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-41abff9f-e8c6-4d43-bd9d-c9b779e741ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:37.482775 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-41abff9f-e8c6-4d43-bd9d-c9b779e741ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:37.483551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-41abff9f-e8c6-4d43-bd9d-c9b779e741ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:37.484017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-41abff9f-e8c6-4d43-bd9d-c9b779e741ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:37.514430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-41abff9f-e8c6-4d43-bd9d-c9b779e741ef tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 May 16 15:19:37.514998 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 250/492] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:37 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:38.528054 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9e0bd2c0-2b54-4931-95b2-3079be65843a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:38.529206 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9e0bd2c0-2b54-4931-95b2-3079be65843a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:38.535367 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9e0bd2c0-2b54-4931-95b2-3079be65843a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:38.535853 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9e0bd2c0-2b54-4931-95b2-3079be65843a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:38.536621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9e0bd2c0-2b54-4931-95b2-3079be65843a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:38.537068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9e0bd2c0-2b54-4931-95b2-3079be65843a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:38.564817 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9e0bd2c0-2b54-4931-95b2-3079be65843a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 May 16 15:19:38.565367 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 243/493] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:38 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:39.576830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1ad436ad-a84b-4686-9b48-361a088ec09d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:39.577774 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1ad436ad-a84b-4686-9b48-361a088ec09d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:39.584149 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1ad436ad-a84b-4686-9b48-361a088ec09d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:39.584598 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1ad436ad-a84b-4686-9b48-361a088ec09d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:39.586123 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1ad436ad-a84b-4686-9b48-361a088ec09d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:39.586557 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1ad436ad-a84b-4686-9b48-361a088ec09d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:39.614596 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1ad436ad-a84b-4686-9b48-361a088ec09d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042000 May 16 15:19:39.615145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 251/494] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:39 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:40.626715 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-cfbaaa47-2219-4477-904f-872823dcd62c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:40.627637 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cfbaaa47-2219-4477-904f-872823dcd62c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:40.634761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cfbaaa47-2219-4477-904f-872823dcd62c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:40.635182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cfbaaa47-2219-4477-904f-872823dcd62c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:40.635969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cfbaaa47-2219-4477-904f-872823dcd62c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:40.636397 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cfbaaa47-2219-4477-904f-872823dcd62c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:40.666424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-cfbaaa47-2219-4477-904f-872823dcd62c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 May 16 15:19:40.666976 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 244/495] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:40 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:41.677991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5c17c76b-1996-4918-9fa1-893674955e75 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:41.679575 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5c17c76b-1996-4918-9fa1-893674955e75 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:41.685978 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5c17c76b-1996-4918-9fa1-893674955e75 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:41.686431 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5c17c76b-1996-4918-9fa1-893674955e75 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:41.687198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5c17c76b-1996-4918-9fa1-893674955e75 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:41.687649 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5c17c76b-1996-4918-9fa1-893674955e75 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:41.715430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5c17c76b-1996-4918-9fa1-893674955e75 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041326 May 16 15:19:41.716003 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 252/496] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:41 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:42.727149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1b811593-d485-4ad4-b734-555358bc0c62 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:42.728096 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1b811593-d485-4ad4-b734-555358bc0c62 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:42.734531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1b811593-d485-4ad4-b734-555358bc0c62 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:42.734977 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1b811593-d485-4ad4-b734-555358bc0c62 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:42.735773 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1b811593-d485-4ad4-b734-555358bc0c62 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:42.736240 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1b811593-d485-4ad4-b734-555358bc0c62 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:42.764346 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1b811593-d485-4ad4-b734-555358bc0c62 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041861 May 16 15:19:42.764886 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 245/497] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:42 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:42.860695 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a2570ded-78f9-4fd4-9928-3a6c22a92e87 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:42.861646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a2570ded-78f9-4fd4-9928-3a6c22a92e87 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:42.868047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a2570ded-78f9-4fd4-9928-3a6c22a92e87 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:42.868508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a2570ded-78f9-4fd4-9928-3a6c22a92e87 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:42.869277 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a2570ded-78f9-4fd4-9928-3a6c22a92e87 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:42.869716 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a2570ded-78f9-4fd4-9928-3a6c22a92e87 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:42.898064 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a2570ded-78f9-4fd4-9928-3a6c22a92e87 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040745 May 16 15:19:42.898610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 253/498] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:42 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:19:42.953570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-36318dba-c43f-47d6-b4ff-7be4828fb2c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:42.954068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-36318dba-c43f-47d6-b4ff-7be4828fb2c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:42.960512 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-36318dba-c43f-47d6-b4ff-7be4828fb2c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:42.960984 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-36318dba-c43f-47d6-b4ff-7be4828fb2c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:42.961854 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-36318dba-c43f-47d6-b4ff-7be4828fb2c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:42.962288 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-36318dba-c43f-47d6-b4ff-7be4828fb2c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:42.987325 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-36318dba-c43f-47d6-b4ff-7be4828fb2c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:19:43.291219 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-36318dba-c43f-47d6-b4ff-7be4828fb2c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 204 len: 0 microversion: 2.1 time: 0.341257 May 16 15:19:43.291818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 246/499] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:19:42 2022] DELETE /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:19:43.299778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-064fb2a7-5872-4cda-9d24-a9cbd76f57d5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:43.300399 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-064fb2a7-5872-4cda-9d24-a9cbd76f57d5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:43.307490 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-064fb2a7-5872-4cda-9d24-a9cbd76f57d5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:43.308016 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-064fb2a7-5872-4cda-9d24-a9cbd76f57d5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:43.308733 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-064fb2a7-5872-4cda-9d24-a9cbd76f57d5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:43.309168 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-064fb2a7-5872-4cda-9d24-a9cbd76f57d5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:43.438825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-064fb2a7-5872-4cda-9d24-a9cbd76f57d5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:43.446413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-064fb2a7-5872-4cda-9d24-a9cbd76f57d5 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1675 microversion: 2.1 time: 0.150425 May 16 15:19:43.446977 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 254/500] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:43 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:43.776856 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-40da824e-508c-41f7-a2a7-66fc73d9663f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:43.777901 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-40da824e-508c-41f7-a2a7-66fc73d9663f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:43.784284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-40da824e-508c-41f7-a2a7-66fc73d9663f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:43.784735 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-40da824e-508c-41f7-a2a7-66fc73d9663f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:43.785500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-40da824e-508c-41f7-a2a7-66fc73d9663f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:43.785934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-40da824e-508c-41f7-a2a7-66fc73d9663f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:43.814087 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-40da824e-508c-41f7-a2a7-66fc73d9663f tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042203 May 16 15:19:43.814634 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 247/501] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:43 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:44.385979 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9acf630b-d59e-409a-ada6-9b81ca4116c6"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:44.387071 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:44.393413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.394012 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.394775 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.395214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.464180 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-14e6fc90-0c7a-4dab-b729-b546cfa142c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:44.464974 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-14e6fc90-0c7a-4dab-b729-b546cfa142c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:44.470890 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-14e6fc90-0c7a-4dab-b729-b546cfa142c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.471411 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-14e6fc90-0c7a-4dab-b729-b546cfa142c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.471696 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Invalid volume: volume 9acf630b-d59e-409a-ada6-9b81ca4116c6 is already attached to instances: e13d168b-75a6-49ab-a169-a941b031915a May 16 15:19:44.472348 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-14e6fc90-0c7a-4dab-b729-b546cfa142c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.472771 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-14e6fc90-0c7a-4dab-b729-b546cfa142c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: POST /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments HTTP/1.1 May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 74 May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:19:44.473403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {"volumeAttachment": {"volumeId": "9acf630b-d59e-409a-ada6-9b81ca4116c6"}} May 16 15:19:44.475023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Invalid volume: volume 9acf630b-d59e-409a-ada6-9b81ca4116c6 is already attached to instances: e13d168b-75a6-49ab-a169-a941b031915a May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'server_id': 'e13d168b-75a6-49ab-a169-a941b031915a', 'body': {'volumeAttachment': {'volumeId': '9acf630b-d59e-409a-ada6-9b81ca4116c6'}}} May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9acf630b-d59e-409a-ada6-9b81ca4116c6 is already attached to instances: e13d168b-75a6-49ab-a169-a941b031915a May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:44.476491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9acf630b-d59e-409a-ada6-9b81ca4116c6 is already attached to instances: e13d168b-75a6-49ab-a169-a941b031915a May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:44.477619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:44.478754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:44.478754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:44.478754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:44.478754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9acf630b-d59e-409a-ada6-9b81ca4116c6 is already attached to instances: e13d168b-75a6-49ab-a169-a941b031915a May 16 15:19:44.478754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:44.478754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 400 to user: Invalid volume: volume 9acf630b-d59e-409a-ada6-9b81ca4116c6 is already attached to instances: e13d168b-75a6-49ab-a169-a941b031915a {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:44.478754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ea83ef15-3202-40d1-8a62-9db2408c6c89 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092900 May 16 15:19:44.478754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 255/502] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:19:44 2022] POST /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:19:44.537591 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ccfc9912-e340-43d4-89e3-8785fa8a738f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:44.538180 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ccfc9912-e340-43d4-89e3-8785fa8a738f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:44.544407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ccfc9912-e340-43d4-89e3-8785fa8a738f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.544859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ccfc9912-e340-43d4-89e3-8785fa8a738f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.545629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ccfc9912-e340-43d4-89e3-8785fa8a738f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.546064 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ccfc9912-e340-43d4-89e3-8785fa8a738f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.609987 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-14e6fc90-0c7a-4dab-b729-b546cfa142c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:44.617482 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-14e6fc90-0c7a-4dab-b729-b546cfa142c1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1675 microversion: 2.1 time: 0.157754 May 16 15:19:44.618050 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 248/503] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:44 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:44.625031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-ccfc9912-e340-43d4-89e3-8785fa8a738f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lazy-loading 'services' on Instance uuid e13d168b-75a6-49ab-a169-a941b031915a {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:44.826444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-834c29f6-f31c-4c94-95fa-4fc6d784f36d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:44.827288 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-834c29f6-f31c-4c94-95fa-4fc6d784f36d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:44.833551 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-834c29f6-f31c-4c94-95fa-4fc6d784f36d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.833995 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-834c29f6-f31c-4c94-95fa-4fc6d784f36d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.835358 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-834c29f6-f31c-4c94-95fa-4fc6d784f36d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.835820 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-834c29f6-f31c-4c94-95fa-4fc6d784f36d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.864289 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-834c29f6-f31c-4c94-95fa-4fc6d784f36d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 May 16 15:19:44.864855 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 249/504] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:44 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:44.869931 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ccfc9912-e340-43d4-89e3-8785fa8a738f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments/9acf630b-d59e-409a-ada6-9b81ca4116c6" status: 202 len: 0 microversion: 2.1 time: 0.336162 May 16 15:19:44.870513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 256/505] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:19:44 2022] DELETE /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments/9acf630b-d59e-409a-ada6-9b81ca4116c6 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:19:44.878630 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d5d4ef8d-6918-4ea5-999b-b5dd7ca7b297 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:44.884150 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d5d4ef8d-6918-4ea5-999b-b5dd7ca7b297 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:44.886165 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5d4ef8d-6918-4ea5-999b-b5dd7ca7b297 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.886604 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5d4ef8d-6918-4ea5-999b-b5dd7ca7b297 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.887352 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5d4ef8d-6918-4ea5-999b-b5dd7ca7b297 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.887808 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5d4ef8d-6918-4ea5-999b-b5dd7ca7b297 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.915905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d5d4ef8d-6918-4ea5-999b-b5dd7ca7b297 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041123 May 16 15:19:44.916450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 250/506] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:44 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:45.637099 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0c41810d-bbae-4ef7-ae93-6f596dbbee42 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:45.637802 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0c41810d-bbae-4ef7-ae93-6f596dbbee42 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:45.643969 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c41810d-bbae-4ef7-ae93-6f596dbbee42 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:45.644419 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c41810d-bbae-4ef7-ae93-6f596dbbee42 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:45.645182 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c41810d-bbae-4ef7-ae93-6f596dbbee42 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:45.645618 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c41810d-bbae-4ef7-ae93-6f596dbbee42 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:45.806511 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0c41810d-bbae-4ef7-ae93-6f596dbbee42 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:45.813761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0c41810d-bbae-4ef7-ae93-6f596dbbee42 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1675 microversion: 2.1 time: 0.182774 May 16 15:19:45.814316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 257/507] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:45 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:45.877057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-dec64e86-12bf-4a1f-a454-33da199d2bd0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:45.882398 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-dec64e86-12bf-4a1f-a454-33da199d2bd0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:45.885428 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dec64e86-12bf-4a1f-a454-33da199d2bd0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:45.885881 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dec64e86-12bf-4a1f-a454-33da199d2bd0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:45.886646 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dec64e86-12bf-4a1f-a454-33da199d2bd0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:45.887082 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dec64e86-12bf-4a1f-a454-33da199d2bd0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:45.917930 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-dec64e86-12bf-4a1f-a454-33da199d2bd0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 May 16 15:19:45.918405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 251/508] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:45 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:45.928241 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cfb67e69-b26f-4b11-806c-54a284308aad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:45.934557 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cfb67e69-b26f-4b11-806c-54a284308aad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:45.935835 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cfb67e69-b26f-4b11-806c-54a284308aad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:45.936293 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cfb67e69-b26f-4b11-806c-54a284308aad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:45.937074 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cfb67e69-b26f-4b11-806c-54a284308aad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:45.937516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cfb67e69-b26f-4b11-806c-54a284308aad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:45.967654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cfb67e69-b26f-4b11-806c-54a284308aad tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 May 16 15:19:45.968901 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 258/509] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:45 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:46.705405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-0873fbb1-90f8-436d-8da9-f1a6685a70c0 req-be92104c-dc3f-498a-8054-0e4d6f447557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccced799-d35d-4fcc-81d1-df03942c2394", "name": "network-vif-deleted", "tag": "fb596391-d69d-41f8-b5d1-5cdf514becf8"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:46.715696 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-0873fbb1-90f8-436d-8da9-f1a6685a70c0 req-be92104c-dc3f-498a-8054-0e4d6f447557 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.716231 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-0873fbb1-90f8-436d-8da9-f1a6685a70c0 req-be92104c-dc3f-498a-8054-0e4d6f447557 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.728125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-0873fbb1-90f8-436d-8da9-f1a6685a70c0 req-be92104c-dc3f-498a-8054-0e4d6f447557 service nova] Creating event network-vif-deleted:fb596391-d69d-41f8-b5d1-5cdf514becf8 for instance ccced799-d35d-4fcc-81d1-df03942c2394 on hv-cinder-84175 May 16 15:19:46.733300 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-0873fbb1-90f8-436d-8da9-f1a6685a70c0 req-be92104c-dc3f-498a-8054-0e4d6f447557 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031472 May 16 15:19:46.733899 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 252/510] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:46.831849 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3ee62b4c-c4eb-46a8-a0bb-140beb974bdb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:46.833161 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3ee62b4c-c4eb-46a8-a0bb-140beb974bdb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:46.842483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3ee62b4c-c4eb-46a8-a0bb-140beb974bdb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.843346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3ee62b4c-c4eb-46a8-a0bb-140beb974bdb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.844504 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3ee62b4c-c4eb-46a8-a0bb-140beb974bdb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.844951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3ee62b4c-c4eb-46a8-a0bb-140beb974bdb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.929714 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3ee62b4c-c4eb-46a8-a0bb-140beb974bdb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:46.931374 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f287935f-a213-40d5-90a1-662d0a758486 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:46.940705 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f287935f-a213-40d5-90a1-662d0a758486 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:46.941719 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3ee62b4c-c4eb-46a8-a0bb-140beb974bdb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1607 microversion: 2.1 time: 0.113849 May 16 15:19:46.943372 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 259/511] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:46 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1607 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:46.949273 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f287935f-a213-40d5-90a1-662d0a758486 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.950723 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f287935f-a213-40d5-90a1-662d0a758486 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.952004 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f287935f-a213-40d5-90a1-662d0a758486 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.953882 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f287935f-a213-40d5-90a1-662d0a758486 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.979832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b02448b1-cbac-4e6a-b439-994d1d94fe9a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:46.980851 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b02448b1-cbac-4e6a-b439-994d1d94fe9a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:46.987072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b02448b1-cbac-4e6a-b439-994d1d94fe9a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.987755 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b02448b1-cbac-4e6a-b439-994d1d94fe9a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.988556 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b02448b1-cbac-4e6a-b439-994d1d94fe9a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.988998 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b02448b1-cbac-4e6a-b439-994d1d94fe9a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:47.004569 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f287935f-a213-40d5-90a1-662d0a758486 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078750 May 16 15:19:47.006296 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 253/512] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:46 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:19:47.026584 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b02448b1-cbac-4e6a-b439-994d1d94fe9a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051652 May 16 15:19:47.027168 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 260/513] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:46 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:47.095495 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f227930d-fab4-4074-acbb-21ba8dd22050 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:47.096143 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f227930d-fab4-4074-acbb-21ba8dd22050 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:47.102777 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f227930d-fab4-4074-acbb-21ba8dd22050 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:47.103354 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f227930d-fab4-4074-acbb-21ba8dd22050 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:47.104180 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f227930d-fab4-4074-acbb-21ba8dd22050 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:47.104614 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f227930d-fab4-4074-acbb-21ba8dd22050 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:47.136622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f227930d-fab4-4074-acbb-21ba8dd22050 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:19:47.439736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f227930d-fab4-4074-acbb-21ba8dd22050 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "DELETE /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 204 len: 0 microversion: 2.1 time: 0.348504 May 16 15:19:47.440714 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 254/514] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:19:47 2022] DELETE /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:19:47.451033 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f6a8aa3d-404f-4a3b-a7cd-56854dca91d0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:47.451673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f6a8aa3d-404f-4a3b-a7cd-56854dca91d0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:47.457834 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f6a8aa3d-404f-4a3b-a7cd-56854dca91d0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:47.458681 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f6a8aa3d-404f-4a3b-a7cd-56854dca91d0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:47.459215 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f6a8aa3d-404f-4a3b-a7cd-56854dca91d0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:47.459685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f6a8aa3d-404f-4a3b-a7cd-56854dca91d0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:47.615296 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f6a8aa3d-404f-4a3b-a7cd-56854dca91d0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:47.623882 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f6a8aa3d-404f-4a3b-a7cd-56854dca91d0 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1689 microversion: 2.1 time: 0.176576 May 16 15:19:47.627668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 261/515] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:47 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:47.963698 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:47.964432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:47.971562 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:47.972045 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:47.972813 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:47.973253 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.006253 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.006781 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.007417 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lazy-loading 'fault' on Instance uuid ccced799-d35d-4fcc-81d1-df03942c2394 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:48.039165 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d52959da-4983-4ad2-a0c3-8d6142f7d392 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:48.040383 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d52959da-4983-4ad2-a0c3-8d6142f7d392 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:48.046833 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d52959da-4983-4ad2-a0c3-8d6142f7d392 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.047367 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d52959da-4983-4ad2-a0c3-8d6142f7d392 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.048361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d52959da-4983-4ad2-a0c3-8d6142f7d392 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.048818 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d52959da-4983-4ad2-a0c3-8d6142f7d392 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.050961 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:48.058656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-26dd5341-02f2-425c-846d-fb7b7a87487f tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1328 microversion: 2.1 time: 0.100640 May 16 15:19:48.059224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 255/516] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:47 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:48.077783 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d52959da-4983-4ad2-a0c3-8d6142f7d392 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043528 May 16 15:19:48.078339 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 262/517] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:19:48 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:19:48.134303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-cdd097b1-1921-4d0c-ac19-0f7a0c84ff6f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:48.134794 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cdd097b1-1921-4d0c-ac19-0f7a0c84ff6f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:48.140670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cdd097b1-1921-4d0c-ac19-0f7a0c84ff6f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.141112 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cdd097b1-1921-4d0c-ac19-0f7a0c84ff6f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.141864 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cdd097b1-1921-4d0c-ac19-0f7a0c84ff6f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.142292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cdd097b1-1921-4d0c-ac19-0f7a0c84ff6f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.167397 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cdd097b1-1921-4d0c-ac19-0f7a0c84ff6f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:19:48.444192 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-cdd097b1-1921-4d0c-ac19-0f7a0c84ff6f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 204 len: 0 microversion: 2.1 time: 0.313680 May 16 15:19:48.444572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 256/518] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:19:48 2022] DELETE /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:19:48.452738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-9302980d-0eab-40f0-ade0-8adae37dcb75 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:48.453351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-9302980d-0eab-40f0-ade0-8adae37dcb75 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:48.459586 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9302980d-0eab-40f0-ade0-8adae37dcb75 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.460197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9302980d-0eab-40f0-ade0-8adae37dcb75 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.460979 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9302980d-0eab-40f0-ade0-8adae37dcb75 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.461409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9302980d-0eab-40f0-ade0-8adae37dcb75 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.590678 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-9302980d-0eab-40f0-ade0-8adae37dcb75 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:48.598035 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-9302980d-0eab-40f0-ade0-8adae37dcb75 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1681 microversion: 2.1 time: 0.149077 May 16 15:19:48.598599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 263/519] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:48 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:48.641988 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-627ab87d-3baa-4dba-b0cc-d8405fa4a399 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:48.642691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-627ab87d-3baa-4dba-b0cc-d8405fa4a399 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:48.649484 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-627ab87d-3baa-4dba-b0cc-d8405fa4a399 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.649937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-627ab87d-3baa-4dba-b0cc-d8405fa4a399 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.650704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-627ab87d-3baa-4dba-b0cc-d8405fa4a399 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:48.651142 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-627ab87d-3baa-4dba-b0cc-d8405fa4a399 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.776632 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-627ab87d-3baa-4dba-b0cc-d8405fa4a399 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:48.784002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-627ab87d-3baa-4dba-b0cc-d8405fa4a399 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1689 microversion: 2.1 time: 0.146189 May 16 15:19:48.784564 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 257/520] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:48 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:49.076757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:49.077349 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:49.083737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.084197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.085594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.086039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.115442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.115935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.116507 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lazy-loading 'fault' on Instance uuid ccced799-d35d-4fcc-81d1-df03942c2394 {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:49.163997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:49.171362 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-139f8b1f-35af-424f-9c6f-f1b629bdcd85 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1328 microversion: 2.1 time: 0.098522 May 16 15:19:49.171955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 264/521] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:49 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:49.616465 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-df62eda3-e9c8-45f6-8ff2-42d9c15724b6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:49.617603 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-df62eda3-e9c8-45f6-8ff2-42d9c15724b6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:49.623959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-df62eda3-e9c8-45f6-8ff2-42d9c15724b6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.624414 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-df62eda3-e9c8-45f6-8ff2-42d9c15724b6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.625197 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-df62eda3-e9c8-45f6-8ff2-42d9c15724b6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.625633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-df62eda3-e9c8-45f6-8ff2-42d9c15724b6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.757418 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-df62eda3-e9c8-45f6-8ff2-42d9c15724b6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:49.764653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-df62eda3-e9c8-45f6-8ff2-42d9c15724b6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1681 microversion: 2.1 time: 0.152632 May 16 15:19:49.765211 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 258/522] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:49 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:49.800850 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c11d6450-2b4f-4fbd-a523-285c1103585b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:49.801459 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c11d6450-2b4f-4fbd-a523-285c1103585b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:49.807898 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c11d6450-2b4f-4fbd-a523-285c1103585b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.808349 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c11d6450-2b4f-4fbd-a523-285c1103585b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.809102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c11d6450-2b4f-4fbd-a523-285c1103585b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.809531 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c11d6450-2b4f-4fbd-a523-285c1103585b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.933614 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c11d6450-2b4f-4fbd-a523-285c1103585b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:49.940915 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c11d6450-2b4f-4fbd-a523-285c1103585b tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1689 microversion: 2.1 time: 0.143812 May 16 15:19:49.941470 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 265/523] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:49 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1689 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:50.188376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:50.188934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:50.194811 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:50.195259 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:50.196039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:50.196472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:50.226557 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:50.226996 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:50.227437 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lazy-loading 'fault' on Instance uuid ccced799-d35d-4fcc-81d1-df03942c2394 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:50.266324 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:50.274299 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0e6e8daf-7324-421d-83fc-a08e55683279 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 200 len: 1328 microversion: 2.1 time: 0.089731 May 16 15:19:50.274853 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 259/524] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:50 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:50.782390 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e6c314bf-912a-414c-90e6-7dfee957b628 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:50.783006 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e6c314bf-912a-414c-90e6-7dfee957b628 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:50.789555 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e6c314bf-912a-414c-90e6-7dfee957b628 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:50.790041 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e6c314bf-912a-414c-90e6-7dfee957b628 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:50.790861 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e6c314bf-912a-414c-90e6-7dfee957b628 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:50.791297 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e6c314bf-912a-414c-90e6-7dfee957b628 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:50.920529 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e6c314bf-912a-414c-90e6-7dfee957b628 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:50.927846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e6c314bf-912a-414c-90e6-7dfee957b628 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1681 microversion: 2.1 time: 0.149364 May 16 15:19:50.929113 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 266/525] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:50 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:50.957301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f09ca600-f8b8-43a7-98b6-9fb030b21651 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:50.957918 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f09ca600-f8b8-43a7-98b6-9fb030b21651 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:50.964659 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f09ca600-f8b8-43a7-98b6-9fb030b21651 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:50.965104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f09ca600-f8b8-43a7-98b6-9fb030b21651 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:50.965858 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f09ca600-f8b8-43a7-98b6-9fb030b21651 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:50.966283 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f09ca600-f8b8-43a7-98b6-9fb030b21651 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:51.090419 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f09ca600-f8b8-43a7-98b6-9fb030b21651 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:51.097576 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f09ca600-f8b8-43a7-98b6-9fb030b21651 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1689 microversion: 2.1 time: 0.144122 May 16 15:19:51.098138 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 260/526] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:50 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1689 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:51.291299 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:51.291872 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:51.297682 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:51.298126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:51.298882 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:51.299310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:51.312769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] HTTP exception thrown: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Request method failure captured: May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 HTTP/1.1 May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmrLB5xOfRztZVakFMBawRxQHhYxucjWEjkdMZvxGHRU_hR_Mq0Uqvt0O3YOIuKVDYJv_4MhNcxLGVqZywPNJMluHGCnsX62qeHlMLqoGfrigWeIRVesLvs3JRUPAYWZxICz71D_vpSnTRaq9oJEBdgixCtjoBcI9fgseAP8L_MgPwk May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:19:51.314352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9886c48c5650408cacaa4e7f78586404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}] May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeTestJSON-2106875596 May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 426aa73007cd4ca3b8c165b87f69c02e May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:19:51.315887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'ccced799-d35d-4fcc-81d1-df03942c2394'} May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:51.316771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:19:51.318171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:51.319736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Returning 404 to user: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:51.319736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-180758bd-6e29-4c38-8ef2-d3e793750b5b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 404 len: 111 microversion: 2.1 time: 0.028894 May 16 15:19:51.319736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 267/527] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:51 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:19:51.324554 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e439af60-8f61-40a2-abcd-8685be0a0319 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '.version_select at 0x7f0c8372a430>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:51.416959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e439af60-8f61-40a2-abcd-8685be0a0319 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425357386" status: 202 len: 0 microversion: 2.1 time: 0.096135 May 16 15:19:51.417525 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 261/528] 10.222.0.71 () {58 vars in 1220 bytes} [Mon May 16 15:19:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425357386 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:51.945885 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4dc400f3-09f0-4c6f-af75-76de694b4a05 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:51.946518 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4dc400f3-09f0-4c6f-af75-76de694b4a05 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:51.953015 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4dc400f3-09f0-4c6f-af75-76de694b4a05 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:51.953472 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4dc400f3-09f0-4c6f-af75-76de694b4a05 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:51.954250 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4dc400f3-09f0-4c6f-af75-76de694b4a05 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:51.954691 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4dc400f3-09f0-4c6f-af75-76de694b4a05 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:52.115104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d4d06f44-f480-44fa-8e66-4a673d6bb81e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:52.115831 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d4d06f44-f480-44fa-8e66-4a673d6bb81e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:52.121819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4d06f44-f480-44fa-8e66-4a673d6bb81e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:52.122341 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4d06f44-f480-44fa-8e66-4a673d6bb81e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:52.123179 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4d06f44-f480-44fa-8e66-4a673d6bb81e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:52.123707 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d4d06f44-f480-44fa-8e66-4a673d6bb81e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:52.155867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4dc400f3-09f0-4c6f-af75-76de694b4a05 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:52.171791 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4dc400f3-09f0-4c6f-af75-76de694b4a05 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1681 microversion: 2.1 time: 0.229895 May 16 15:19:52.172369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 268/529] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:51 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:52.176966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0c75b55e-0d17-4085-968c-19ca530336c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'create', calling method: .version_select at 0x7f0c882a9b80>, body: {"keypair": {"name": "tempest-keypair-459007666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1bEqe+06g76Koi6on/4sNVo21dgfWscxMILhD+WkjYwXB7JTUHbZvYEiyD5yjMbiFzrlYmyfF7beFEsrK/URDJ3egDOHJv7kfrDW/jx8AGiEjE+yfAbjJlzkc7SIkN3g=="}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:52.190618 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-0c75b55e-0d17-4085-968c-19ca530336c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Getting quotas for project 9886c48c5650408cacaa4e7f78586404. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:52.195675 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-0c75b55e-0d17-4085-968c-19ca530336c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Getting quotas for user 426aa73007cd4ca3b8c165b87f69c02e and project 9886c48c5650408cacaa4e7f78586404. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:52.259347 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d4d06f44-f480-44fa-8e66-4a673d6bb81e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:52.266918 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d4d06f44-f480-44fa-8e66-4a673d6bb81e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1689 microversion: 2.1 time: 0.156201 May 16 15:19:52.267470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 262/530] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:52 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:52.277001 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0c75b55e-0d17-4085-968c-19ca530336c6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103448 May 16 15:19:52.277587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 269/531] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:19:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:53.191418 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-751435ee-10c1-40ef-8931-d3b3368ee3cd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:53.192147 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-751435ee-10c1-40ef-8931-d3b3368ee3cd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:53.198967 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-751435ee-10c1-40ef-8931-d3b3368ee3cd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:53.199524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-751435ee-10c1-40ef-8931-d3b3368ee3cd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:53.200390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-751435ee-10c1-40ef-8931-d3b3368ee3cd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:53.200905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-751435ee-10c1-40ef-8931-d3b3368ee3cd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:53.286137 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4453783c-e4c8-4d83-821a-a1fddd25f45d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:53.286668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4453783c-e4c8-4d83-821a-a1fddd25f45d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:53.294156 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4453783c-e4c8-4d83-821a-a1fddd25f45d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:53.294608 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4453783c-e4c8-4d83-821a-a1fddd25f45d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:53.295403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4453783c-e4c8-4d83-821a-a1fddd25f45d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:53.295862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4453783c-e4c8-4d83-821a-a1fddd25f45d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:53.756017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4453783c-e4c8-4d83-821a-a1fddd25f45d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:53.766503 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-751435ee-10c1-40ef-8931-d3b3368ee3cd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:53.775285 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-751435ee-10c1-40ef-8931-d3b3368ee3cd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1681 microversion: 2.1 time: 0.589140 May 16 15:19:53.775893 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 263/532] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:53 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1681 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:53.777312 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4453783c-e4c8-4d83-821a-a1fddd25f45d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1689 microversion: 2.1 time: 0.495991 May 16 15:19:53.778324 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 270/533] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:53 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1689 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:54.211145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-e9f0f3d1-8030-4c78-b882-d38b74f34a19 req-751e1e68-eef5-42a2-ab88-d508fc194848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d612141-6fe0-4d49-b1aa-071acc497104", "name": "network-vif-deleted", "tag": "75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:54.227825 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-e9f0f3d1-8030-4c78-b882-d38b74f34a19 req-751e1e68-eef5-42a2-ab88-d508fc194848 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:54.228272 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-e9f0f3d1-8030-4c78-b882-d38b74f34a19 req-751e1e68-eef5-42a2-ab88-d508fc194848 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:54.268447 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-e9f0f3d1-8030-4c78-b882-d38b74f34a19 req-751e1e68-eef5-42a2-ab88-d508fc194848 service nova] Creating event network-vif-deleted:75a3eecb-d4be-47dd-a94a-ce5c9bc0c45b for instance 4d612141-6fe0-4d49-b1aa-071acc497104 on hv-cinder-84175 May 16 15:19:54.276814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-e9f0f3d1-8030-4c78-b882-d38b74f34a19 req-751e1e68-eef5-42a2-ab88-d508fc194848 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069640 May 16 15:19:54.278391 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 264/534] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:54.759315 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1448521296", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5d840d6-be4b-4ccc-949a-d641977c970e"}], "security_groups": [{"name": "tempest-securitygroup--592806692"}], "key_name": "tempest-keypair-459007666", "user_data": "}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:54.795316 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:54.796305 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:54.813420 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:54.813898 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:54.815175 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:54.815652 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:54.863845 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:54.864631 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:54.865301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lazy-loading 'fault' on Instance uuid e13d168b-75a6-49ab-a169-a941b031915a {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:54.903822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] validate_networks() for [('d5d840d6-be4b-4ccc-949a-d641977c970e', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:19:54.933020 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:54.946828 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c1506ed4-277d-4feb-88a4-9ae4252313f5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 200 len: 1331 microversion: 2.1 time: 0.155016 May 16 15:19:54.948138 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 265/535] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:54 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 1331 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:54.956911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:54.958770 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:54.980749 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:54.981586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:54.982578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:54.983242 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:55.046498 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:55.047531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:55.048504 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lazy-loading 'fault' on Instance uuid 4d612141-6fe0-4d49-b1aa-071acc497104 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:55.112372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:55.123297 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1a5d6463-e0bc-4872-9a07-be888b5d9ef4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 200 len: 1333 microversion: 2.1 time: 0.173449 May 16 15:19:55.124365 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 266/536] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:54 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 1333 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:55.376805 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:19:55.377240 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:19:55.377721 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:19:55.378132 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:19:55.378726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:19:55.392629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:55.393155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:55.394415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:55.394747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:55.419395 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Getting quotas for project 9886c48c5650408cacaa4e7f78586404. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:55.425107 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Getting quotas for user 426aa73007cd4ca3b8c165b87f69c02e and project 9886c48c5650408cacaa4e7f78586404. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:55.450866 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:19:55.454755 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:19:55.641405 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-bce62efc-1038-4479-a988-f2b1c196d477 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.886845 May 16 15:19:55.648030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 271/537] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:19:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:19:55.653593 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7d8373de-d2e9-4805-81bd-54643afe59d1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:55.654221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7d8373de-d2e9-4805-81bd-54643afe59d1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:55.713497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7d8373de-d2e9-4805-81bd-54643afe59d1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:55.722176 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7d8373de-d2e9-4805-81bd-54643afe59d1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1237 microversion: 2.1 time: 0.072685 May 16 15:19:55.722985 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 267/538] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:55 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:55.966185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:55.966809 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:55.974597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:55.975051 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:55.976290 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:55.976740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:55.989996 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a HTTP/1.1 May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:19:55.991778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:19:55.993317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'e13d168b-75a6-49ab-a169-a941b031915a'} May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:55.994117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:19:55.995373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:55.996715 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:55.996715 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6c657c2c-3cde-4b60-935a-099596b4d286 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 404 len: 111 microversion: 2.1 time: 0.031558 May 16 15:19:55.996715 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 272/539] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:55 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:19:56.002033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3982a5c0-b81f-4ee3-b444-48ba28a722c7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '.version_select at 0x7f0c83712ee0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:56.099672 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3982a5c0-b81f-4ee3-b444-48ba28a722c7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-140393480" status: 202 len: 0 microversion: 2.1 time: 0.101346 May 16 15:19:56.100472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 268/540] 10.222.0.71 () {58 vars in 1217 bytes} [Mon May 16 15:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-140393480 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:56.141084 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:56.141700 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 4d612141-6fe0-4d49-b1aa-071acc497104] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:56.148156 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:56.148761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:56.153047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:56.153047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:56.165331 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] HTTP exception thrown: Instance 4d612141-6fe0-4d49-b1aa-071acc497104 could not be found. May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Request method failure captured: May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 HTTP/1.1 May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqGYNjACNTPuCxQ5tAZjCeNsclj3zBLZYCT0GzhAYLlpUn7x7SwrEZyHipo_-S1Q3XoVpY2bMG8R1hUmX1nlVK9ChFgSDPfiZHV59Z455s8uTYO82BgZA5rt6rI8q4vWGnMjFPQikO1qUS6XBYaU0uepOS4NRKl-OUss-l4Cc_aveg May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:19:56.166858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}] May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 97021ddaffff4e088961ba1873a8e697 May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 4d612141-6fe0-4d49-b1aa-071acc497104 could not be found. May 16 15:19:56.168379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '4d612141-6fe0-4d49-b1aa-071acc497104'} May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d612141-6fe0-4d49-b1aa-071acc497104 could not be found. May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:56.169244 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d612141-6fe0-4d49-b1aa-071acc497104 could not be found. May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d612141-6fe0-4d49-b1aa-071acc497104 could not be found. May 16 15:19:56.170603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:19:56.172830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Returning 404 to user: Instance 4d612141-6fe0-4d49-b1aa-071acc497104 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:56.172830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-90b9be7f-4b11-4586-bdc5-11a698c19c3c tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104" status: 404 len: 111 microversion: 2.1 time: 0.030968 May 16 15:19:56.172830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 273/541] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:56 2022] GET /compute/v2.1/servers/4d612141-6fe0-4d49-b1aa-071acc497104 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:19:56.177042 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-25b88331-5cc4-43c1-a68f-58ca77cee114 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '.version_select at 0x7f0c837719d0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:56.279918 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-25b88331-5cc4-43c1-a68f-58ca77cee114 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491694629" status: 202 len: 0 microversion: 2.1 time: 0.106545 May 16 15:19:56.280507 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 269/542] 10.222.0.71 () {58 vars in 1217 bytes} [Mon May 16 15:19:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491694629 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:56.309720 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-82e1171d-3ede-4036-b448-62c4c0650edf req-5b24f091-da2a-4fa1-a5f5-621689349a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13d168b-75a6-49ab-a169-a941b031915a", "name": "network-vif-deleted", "tag": "b8ba8a30-4e6a-49c8-9ac0-4617f3c6e507"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:56.318415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-82e1171d-3ede-4036-b448-62c4c0650edf req-5b24f091-da2a-4fa1-a5f5-621689349a70 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:56.321506 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-82e1171d-3ede-4036-b448-62c4c0650edf req-5b24f091-da2a-4fa1-a5f5-621689349a70 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:56.331324 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-82e1171d-3ede-4036-b448-62c4c0650edf req-5b24f091-da2a-4fa1-a5f5-621689349a70 service nova] Creating event network-vif-deleted:b8ba8a30-4e6a-49c8-9ac0-4617f3c6e507 for instance e13d168b-75a6-49ab-a169-a941b031915a on hv-cinder-84175 May 16 15:19:56.336541 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-82e1171d-3ede-4036-b448-62c4c0650edf req-5b24f091-da2a-4fa1-a5f5-621689349a70 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 May 16 15:19:56.337377 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 274/543] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:56.740648 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3374495f-83d6-481a-9032-2372ecf6bb88 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:56.741816 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3374495f-83d6-481a-9032-2372ecf6bb88 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:56.748314 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3374495f-83d6-481a-9032-2372ecf6bb88 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:56.748759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3374495f-83d6-481a-9032-2372ecf6bb88 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:56.749537 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3374495f-83d6-481a-9032-2372ecf6bb88 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:56.750046 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3374495f-83d6-481a-9032-2372ecf6bb88 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:56.817189 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3374495f-83d6-481a-9032-2372ecf6bb88 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:56.824494 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3374495f-83d6-481a-9032-2372ecf6bb88 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1241 microversion: 2.1 time: 0.088178 May 16 15:19:56.825056 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 270/544] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:56 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:56.941037 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3f8ca0fa-856a-4d92-8f1b-7d3b67471549 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: .version_select at 0x7f0c88049310>, body: {"keypair": {"name": "tempest-keypair-1765210552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjC5wXRhdeK2uTNrR7CpwoeAUhV3BMrCXzU+d5G7gMfqNrqHXyu2A7cMdyq/vIqeUOzpelDbfRdTjuZq+GGP0PxV7+D5OqUQDU5+v5J3dJGq7UGW0mW43WW2CGluElNmA=="}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:56.955064 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-3f8ca0fa-856a-4d92-8f1b-7d3b67471549 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:56.960725 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-3f8ca0fa-856a-4d92-8f1b-7d3b67471549 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for user d38cdf40e33b47d8aa79e029cded7503 and project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:57.028972 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3f8ca0fa-856a-4d92-8f1b-7d3b67471549 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092065 May 16 15:19:57.034700 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 275/545] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:19:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:57.846281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ab2a122f-b9c1-410f-a2aa-311efdad3b36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:57.846925 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ab2a122f-b9c1-410f-a2aa-311efdad3b36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:57.854295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ab2a122f-b9c1-410f-a2aa-311efdad3b36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:57.854737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ab2a122f-b9c1-410f-a2aa-311efdad3b36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:57.855598 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ab2a122f-b9c1-410f-a2aa-311efdad3b36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:57.856218 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ab2a122f-b9c1-410f-a2aa-311efdad3b36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:57.932452 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ab2a122f-b9c1-410f-a2aa-311efdad3b36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:57.939904 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ab2a122f-b9c1-410f-a2aa-311efdad3b36 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1297 microversion: 2.1 time: 0.101345 May 16 15:19:57.940479 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 271/546] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:57 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:58.957599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3115c516-9625-4be1-af3c-dd080bf060aa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:58.958502 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3115c516-9625-4be1-af3c-dd080bf060aa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:58.965479 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3115c516-9625-4be1-af3c-dd080bf060aa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:58.965929 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3115c516-9625-4be1-af3c-dd080bf060aa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:58.966702 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3115c516-9625-4be1-af3c-dd080bf060aa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:58.967139 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3115c516-9625-4be1-af3c-dd080bf060aa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:59.161906 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3115c516-9625-4be1-af3c-dd080bf060aa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:59.170034 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3115c516-9625-4be1-af3c-dd080bf060aa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.216851 May 16 15:19:59.170794 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 276/547] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:19:58 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:59.266762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-235881631", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a605965-a559-434b-a7bc-1500d5306bfd"}], "security_groups": [{"name": "tempest-securitygroup--1692486229"}], "key_name": "tempest-keypair-1765210552", "user_data": "}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:59.400260 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] validate_networks() for [('1a605965-a559-434b-a7bc-1500d5306bfd', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:19:59.737378 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a89404cd-6ea9-4919-9b6c-2a065bea151e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:59.737912 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a89404cd-6ea9-4919-9b6c-2a065bea151e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:59.745681 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a89404cd-6ea9-4919-9b6c-2a065bea151e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:59.746176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a89404cd-6ea9-4919-9b6c-2a065bea151e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:59.747039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a89404cd-6ea9-4919-9b6c-2a065bea151e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:59.747749 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a89404cd-6ea9-4919-9b6c-2a065bea151e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:59.777764 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a89404cd-6ea9-4919-9b6c-2a065bea151e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:19:59.925745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:19:59.926164 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:19:59.926631 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:19:59.927038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:19:59.927444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:19:59.936573 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:59.937021 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:59.937841 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:59.938271 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:59.954887 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:59.958703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Getting quotas for user d38cdf40e33b47d8aa79e029cded7503 and project 56ba8d3ade6e4efd90ce4c340464c565. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:59.969931 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:19:59.972276 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:20:00.054039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a89404cd-6ea9-4919-9b6c-2a065bea151e tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "DELETE /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 204 len: 0 microversion: 2.1 time: 0.320895 May 16 15:20:00.054731 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 277/548] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:19:59 2022] DELETE /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:20:00.059748 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-73e6279d-5f88-483d-b7f5-486607dff324 req-ca1e7abf-2bbb-4f59-ae35-b671fa95a120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6202deb8-088f-46e8-bd66-7377b00f7305", "tag": "15f9e43d-7e6a-475f-922e-a92ad8c84c97"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:00.068864 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-73e6279d-5f88-483d-b7f5-486607dff324 req-ca1e7abf-2bbb-4f59-ae35-b671fa95a120 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:00.068864 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-73e6279d-5f88-483d-b7f5-486607dff324 req-ca1e7abf-2bbb-4f59-ae35-b671fa95a120 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:00.079103 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-73e6279d-5f88-483d-b7f5-486607dff324 req-ca1e7abf-2bbb-4f59-ae35-b671fa95a120 service nova] Creating event network-changed:15f9e43d-7e6a-475f-922e-a92ad8c84c97 for instance 6202deb8-088f-46e8-bd66-7377b00f7305 on hv-cinder-84175 May 16 15:20:00.084000 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-73e6279d-5f88-483d-b7f5-486607dff324 req-ca1e7abf-2bbb-4f59-ae35-b671fa95a120 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027956 May 16 15:20:00.084941 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 278/549] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:00.089834 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7c33ee24-cb70-4343-8f6f-8f415080c974 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:00.090520 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7c33ee24-cb70-4343-8f6f-8f415080c974 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:00.097756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7c33ee24-cb70-4343-8f6f-8f415080c974 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:00.097756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7c33ee24-cb70-4343-8f6f-8f415080c974 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:00.098191 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7c33ee24-cb70-4343-8f6f-8f415080c974 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:00.098625 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7c33ee24-cb70-4343-8f6f-8f415080c974 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:00.114967 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-27262152-624d-4000-8829-4d26c1d2bc9e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.854450 May 16 15:20:00.116522 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 272/550] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:19:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:20:00.126963 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-626ab15b-03bd-4745-a575-e5d3ad9e853d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:00.127228 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-626ab15b-03bd-4745-a575-e5d3ad9e853d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:00.458816 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-626ab15b-03bd-4745-a575-e5d3ad9e853d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:00.466385 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-626ab15b-03bd-4745-a575-e5d3ad9e853d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1241 microversion: 2.1 time: 0.343689 May 16 15:20:00.467153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 273/551] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:00 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1241 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:00.481759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0e067a4c-8a47-42ed-ba48-ab3dd7d11577 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:00.482365 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0e067a4c-8a47-42ed-ba48-ab3dd7d11577 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:00.488517 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e067a4c-8a47-42ed-ba48-ab3dd7d11577 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:00.488962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e067a4c-8a47-42ed-ba48-ab3dd7d11577 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:00.489734 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e067a4c-8a47-42ed-ba48-ab3dd7d11577 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:00.490165 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e067a4c-8a47-42ed-ba48-ab3dd7d11577 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:00.536777 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7c33ee24-cb70-4343-8f6f-8f415080c974 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:00.544836 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7c33ee24-cb70-4343-8f6f-8f415080c974 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1509 microversion: 2.1 time: 0.458798 May 16 15:20:00.545414 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 279/552] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:00 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:00.621416 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0e067a4c-8a47-42ed-ba48-ab3dd7d11577 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:00.628937 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0e067a4c-8a47-42ed-ba48-ab3dd7d11577 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.151014 May 16 15:20:00.629504 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 274/553] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:00 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:01.484086 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6ad00506-266b-4f7b-a6a5-d4641fd3fd7f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:01.484703 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6ad00506-266b-4f7b-a6a5-d4641fd3fd7f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:01.491880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6ad00506-266b-4f7b-a6a5-d4641fd3fd7f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:01.492509 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6ad00506-266b-4f7b-a6a5-d4641fd3fd7f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:01.493284 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6ad00506-266b-4f7b-a6a5-d4641fd3fd7f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:01.493723 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6ad00506-266b-4f7b-a6a5-d4641fd3fd7f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:01.552864 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6ad00506-266b-4f7b-a6a5-d4641fd3fd7f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:01.560649 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6ad00506-266b-4f7b-a6a5-d4641fd3fd7f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1245 microversion: 2.1 time: 0.080513 May 16 15:20:01.561206 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 280/554] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:01 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:01.562234 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c8dee4df-7856-47f1-a75b-0b71c1e58094 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:01.562859 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c8dee4df-7856-47f1-a75b-0b71c1e58094 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:01.569243 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c8dee4df-7856-47f1-a75b-0b71c1e58094 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:01.569692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c8dee4df-7856-47f1-a75b-0b71c1e58094 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:01.571115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c8dee4df-7856-47f1-a75b-0b71c1e58094 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:01.571620 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c8dee4df-7856-47f1-a75b-0b71c1e58094 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:01.645855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b2b45e4f-1d26-4557-9bfe-429a4c2c24f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:01.646868 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b2b45e4f-1d26-4557-9bfe-429a4c2c24f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:01.653697 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2b45e4f-1d26-4557-9bfe-429a4c2c24f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:01.654233 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2b45e4f-1d26-4557-9bfe-429a4c2c24f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:01.655017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2b45e4f-1d26-4557-9bfe-429a4c2c24f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:01.655455 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b2b45e4f-1d26-4557-9bfe-429a4c2c24f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:01.704873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c8dee4df-7856-47f1-a75b-0b71c1e58094 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:01.712652 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c8dee4df-7856-47f1-a75b-0b71c1e58094 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1509 microversion: 2.1 time: 0.154307 May 16 15:20:01.713413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 275/555] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:01 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:01.787765 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b2b45e4f-1d26-4557-9bfe-429a4c2c24f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:01.795690 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b2b45e4f-1d26-4557-9bfe-429a4c2c24f6 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.153741 May 16 15:20:01.796266 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 281/556] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:01 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:02.577896 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a0dade9c-4d75-444d-9f2f-1328393b5607 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:02.578406 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a0dade9c-4d75-444d-9f2f-1328393b5607 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:02.584732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a0dade9c-4d75-444d-9f2f-1328393b5607 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:02.585181 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a0dade9c-4d75-444d-9f2f-1328393b5607 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:02.586018 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a0dade9c-4d75-444d-9f2f-1328393b5607 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:02.587581 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a0dade9c-4d75-444d-9f2f-1328393b5607 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:02.653560 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a0dade9c-4d75-444d-9f2f-1328393b5607 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:02.660957 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a0dade9c-4d75-444d-9f2f-1328393b5607 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1237 microversion: 2.1 time: 0.086930 May 16 15:20:02.661531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 276/557] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:02 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:02.729829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4c12f7ff-e944-419a-a7ab-d4212d524194 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:02.730492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4c12f7ff-e944-419a-a7ab-d4212d524194 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:02.737036 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c12f7ff-e944-419a-a7ab-d4212d524194 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:02.737497 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c12f7ff-e944-419a-a7ab-d4212d524194 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:02.738269 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c12f7ff-e944-419a-a7ab-d4212d524194 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:02.738743 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c12f7ff-e944-419a-a7ab-d4212d524194 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:02.813131 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7f6f158e-dddd-4695-b41f-3cbef525d4bd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:02.813744 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7f6f158e-dddd-4695-b41f-3cbef525d4bd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:02.819473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f6f158e-dddd-4695-b41f-3cbef525d4bd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:02.819956 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f6f158e-dddd-4695-b41f-3cbef525d4bd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:02.821889 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f6f158e-dddd-4695-b41f-3cbef525d4bd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:02.822334 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f6f158e-dddd-4695-b41f-3cbef525d4bd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:02.896336 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4c12f7ff-e944-419a-a7ab-d4212d524194 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:02.903978 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4c12f7ff-e944-419a-a7ab-d4212d524194 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1509 microversion: 2.1 time: 0.178103 May 16 15:20:02.904645 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 282/558] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:02 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:02.960044 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7f6f158e-dddd-4695-b41f-3cbef525d4bd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:02.967429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7f6f158e-dddd-4695-b41f-3cbef525d4bd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.158110 May 16 15:20:02.968037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 277/559] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:02 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:03.678322 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a80d4af0-92b9-43cf-92f5-3922c171fb19 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:03.678945 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a80d4af0-92b9-43cf-92f5-3922c171fb19 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:03.685077 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a80d4af0-92b9-43cf-92f5-3922c171fb19 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:03.685530 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a80d4af0-92b9-43cf-92f5-3922c171fb19 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:03.686304 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a80d4af0-92b9-43cf-92f5-3922c171fb19 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:03.686743 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a80d4af0-92b9-43cf-92f5-3922c171fb19 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:03.768603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a80d4af0-92b9-43cf-92f5-3922c171fb19 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:03.776659 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a80d4af0-92b9-43cf-92f5-3922c171fb19 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1293 microversion: 2.1 time: 0.102241 May 16 15:20:03.777405 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 283/560] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:03 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:03.922466 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d9c05b01-41aa-4927-a4ac-e6b857be04ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:03.924215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d9c05b01-41aa-4927-a4ac-e6b857be04ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:03.931877 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d9c05b01-41aa-4927-a4ac-e6b857be04ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:03.936558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d9c05b01-41aa-4927-a4ac-e6b857be04ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:03.936558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d9c05b01-41aa-4927-a4ac-e6b857be04ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:03.936558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d9c05b01-41aa-4927-a4ac-e6b857be04ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:03.983905 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-941687ff-424e-4c8b-ab43-d68caf83280b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:03.985373 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-941687ff-424e-4c8b-ab43-d68caf83280b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:03.994173 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-941687ff-424e-4c8b-ab43-d68caf83280b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:03.994949 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-941687ff-424e-4c8b-ab43-d68caf83280b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:03.996182 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-941687ff-424e-4c8b-ab43-d68caf83280b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:03.996929 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-941687ff-424e-4c8b-ab43-d68caf83280b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:04.077969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d9c05b01-41aa-4927-a4ac-e6b857be04ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:04.085908 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d9c05b01-41aa-4927-a4ac-e6b857be04ed tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1467 microversion: 2.1 time: 0.167397 May 16 15:20:04.086801 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 278/561] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:03 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1467 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:04.091395 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-ca600705-9be4-4a43-8c5f-c662b16cfea3 req-f75d0766-ef54-4de1-9ea3-53cbbee638af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c116f9-b96a-4690-9ebd-8ceb7f806e18", "name": "network-vif-deleted", "tag": "0605d368-ac3c-4f23-b5ff-e1c7656542f5"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:04.100168 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-ca600705-9be4-4a43-8c5f-c662b16cfea3 req-f75d0766-ef54-4de1-9ea3-53cbbee638af service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:04.100859 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-ca600705-9be4-4a43-8c5f-c662b16cfea3 req-f75d0766-ef54-4de1-9ea3-53cbbee638af service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:04.113196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-ca600705-9be4-4a43-8c5f-c662b16cfea3 req-f75d0766-ef54-4de1-9ea3-53cbbee638af service nova] Creating event network-vif-deleted:0605d368-ac3c-4f23-b5ff-e1c7656542f5 for instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 on hv-cinder-84175 May 16 15:20:04.118701 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-ca600705-9be4-4a43-8c5f-c662b16cfea3 req-f75d0766-ef54-4de1-9ea3-53cbbee638af service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030570 May 16 15:20:04.119305 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 279/562] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:04.272177 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-941687ff-424e-4c8b-ab43-d68caf83280b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:04.280975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-941687ff-424e-4c8b-ab43-d68caf83280b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.300757 May 16 15:20:04.287536 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ac757610-aa4a-4be9-ac8c-1916c6c1c38e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:04.288159 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ac757610-aa4a-4be9-ac8c-1916c6c1c38e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:04.288281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 284/563] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:03 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:04.302471 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ac757610-aa4a-4be9-ac8c-1916c6c1c38e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:04.302922 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ac757610-aa4a-4be9-ac8c-1916c6c1c38e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:04.303726 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ac757610-aa4a-4be9-ac8c-1916c6c1c38e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:04.304164 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ac757610-aa4a-4be9-ac8c-1916c6c1c38e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:04.344577 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ac757610-aa4a-4be9-ac8c-1916c6c1c38e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/ips" status: 200 len: 151 microversion: 2.20 time: 0.061578 May 16 15:20:04.345154 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 280/564] 10.222.0.71 () {60 vars in 1288 bytes} [Mon May 16 15:20:04 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:20:04.792499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-decb8ca4-45a1-4461-bf03-ebcc1d02f4dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:04.793109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-decb8ca4-45a1-4461-bf03-ebcc1d02f4dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:04.799600 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-decb8ca4-45a1-4461-bf03-ebcc1d02f4dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:04.800086 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-decb8ca4-45a1-4461-bf03-ebcc1d02f4dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:04.800844 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-decb8ca4-45a1-4461-bf03-ebcc1d02f4dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:04.801274 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-decb8ca4-45a1-4461-bf03-ebcc1d02f4dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:04.883618 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-decb8ca4-45a1-4461-bf03-ebcc1d02f4dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:04.893780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-decb8ca4-45a1-4461-bf03-ebcc1d02f4dd tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1299 microversion: 2.1 time: 0.105082 May 16 15:20:04.900384 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 285/565] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:04 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:05.107122 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:05.108310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:05.121306 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:05.121760 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:05.123306 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:05.123306 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:05.157955 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:05.158658 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:05.159122 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lazy-loading 'fault' on Instance uuid 04c116f9-b96a-4690-9ebd-8ceb7f806e18 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:05.218187 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:05.225964 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-411136da-a1e7-4fe9-b16d-645b95fbc298 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 200 len: 1312 microversion: 2.1 time: 0.122673 May 16 15:20:05.226562 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 281/566] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:05 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:05.305690 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-029bd2cd-ee56-4f75-9b55-0dcec4cfeb03 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:05.306316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-029bd2cd-ee56-4f75-9b55-0dcec4cfeb03 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:05.312712 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-029bd2cd-ee56-4f75-9b55-0dcec4cfeb03 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:05.313174 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-029bd2cd-ee56-4f75-9b55-0dcec4cfeb03 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:05.314000 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-029bd2cd-ee56-4f75-9b55-0dcec4cfeb03 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:05.314438 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-029bd2cd-ee56-4f75-9b55-0dcec4cfeb03 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:05.540594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-029bd2cd-ee56-4f75-9b55-0dcec4cfeb03 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:05.548283 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-029bd2cd-ee56-4f75-9b55-0dcec4cfeb03 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.246837 May 16 15:20:05.548976 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 286/567] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:05 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:05.920949 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a2c833ab-1809-43a1-bbbf-b29cf05a3ce3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:05.921574 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a2c833ab-1809-43a1-bbbf-b29cf05a3ce3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:05.927672 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a2c833ab-1809-43a1-bbbf-b29cf05a3ce3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:05.928357 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a2c833ab-1809-43a1-bbbf-b29cf05a3ce3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:05.929301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a2c833ab-1809-43a1-bbbf-b29cf05a3ce3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:05.929940 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a2c833ab-1809-43a1-bbbf-b29cf05a3ce3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.127040 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a2c833ab-1809-43a1-bbbf-b29cf05a3ce3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:06.134429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a2c833ab-1809-43a1-bbbf-b29cf05a3ce3 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.217799 May 16 15:20:06.134990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 282/568] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:05 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:06.243821 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:06.244486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 04c116f9-b96a-4690-9ebd-8ceb7f806e18] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:06.252268 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-7dfcee6c-ffdb-4f5d-a5f1-4de8f8d311fd req-1e037855-0a16-46f1-aa51-e0435127fc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34eda1a0-162b-4515-b35a-ac5e49da4a9a", "tag": "ba75bca4-77b3-4ced-9d61-2fae4f3a831b"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:06.262649 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.264660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-7dfcee6c-ffdb-4f5d-a5f1-4de8f8d311fd req-1e037855-0a16-46f1-aa51-e0435127fc8e service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.265307 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-7dfcee6c-ffdb-4f5d-a5f1-4de8f8d311fd req-1e037855-0a16-46f1-aa51-e0435127fc8e service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.268296 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.271775 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.271775 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.283807 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-7dfcee6c-ffdb-4f5d-a5f1-4de8f8d311fd req-1e037855-0a16-46f1-aa51-e0435127fc8e service nova] Creating event network-changed:ba75bca4-77b3-4ced-9d61-2fae4f3a831b for instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a on hv-cinder-84175 May 16 15:20:06.289320 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-7dfcee6c-ffdb-4f5d-a5f1-4de8f8d311fd req-1e037855-0a16-46f1-aa51-e0435127fc8e service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040561 May 16 15:20:06.290633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 283/569] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:06.291375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] HTTP exception thrown: Instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 could not be found. May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Request method failure captured: May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 HTTP/1.1 May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqGYNjACNTPuCxQ5tAZjCeNsclj3zBLZYCT0GzhAYLlpUn7x7SwrEZyHipo_-S1Q3XoVpY2bMG8R1hUmX1nlVK9ChFgSDPfiZHV59Z455s8uTYO82BgZA5rt6rI8q4vWGnMjFPQikO1qUS6XBYaU0uepOS4NRKl-OUss-l4Cc_aveg May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:20:06.293028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}] May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 97021ddaffff4e088961ba1873a8e697 May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 could not be found. May 16 15:20:06.294532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '04c116f9-b96a-4690-9ebd-8ceb7f806e18'} May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 could not be found. May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:06.295426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 could not be found. May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 could not be found. May 16 15:20:06.296778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:20:06.297878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Returning 404 to user: Instance 04c116f9-b96a-4690-9ebd-8ceb7f806e18 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:06.297878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5427846c-8d03-47dc-98ef-03d309c302d7 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18" status: 404 len: 111 microversion: 2.1 time: 0.054690 May 16 15:20:06.297878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 287/570] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:06 2022] GET /compute/v2.1/servers/04c116f9-b96a-4690-9ebd-8ceb7f806e18 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:20:06.303682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ff145628-f598-4af2-95b3-1058ae811d40 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:06.304936 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ff145628-f598-4af2-95b3-1058ae811d40 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:06.311452 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ff145628-f598-4af2-95b3-1058ae811d40 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.311994 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ff145628-f598-4af2-95b3-1058ae811d40 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.312720 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ff145628-f598-4af2-95b3-1058ae811d40 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.313159 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ff145628-f598-4af2-95b3-1058ae811d40 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.341559 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ff145628-f598-4af2-95b3-1058ae811d40 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:20:06.532386 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-89c4e224-04e3-482f-bcfc-b6e88b2f82cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:06.532829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-89c4e224-04e3-482f-bcfc-b6e88b2f82cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:06.539270 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-89c4e224-04e3-482f-bcfc-b6e88b2f82cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.540164 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-89c4e224-04e3-482f-bcfc-b6e88b2f82cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.540956 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-89c4e224-04e3-482f-bcfc-b6e88b2f82cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.541389 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-89c4e224-04e3-482f-bcfc-b6e88b2f82cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.583997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-89c4e224-04e3-482f-bcfc-b6e88b2f82cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lazy-loading 'flavor' on Instance uuid 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:06.633929 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ff145628-f598-4af2-95b3-1058ae811d40 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "DELETE /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 204 len: 0 microversion: 2.1 time: 0.333504 May 16 15:20:06.634738 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 284/571] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:20:06 2022] DELETE /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:20:06.639902 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-621016af-1be4-4b59-9c4e-1a885db22e3a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:06.641160 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-621016af-1be4-4b59-9c4e-1a885db22e3a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:06.646712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-621016af-1be4-4b59-9c4e-1a885db22e3a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.647159 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-621016af-1be4-4b59-9c4e-1a885db22e3a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.647996 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-621016af-1be4-4b59-9c4e-1a885db22e3a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.648426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-621016af-1be4-4b59-9c4e-1a885db22e3a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.790244 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-621016af-1be4-4b59-9c4e-1a885db22e3a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:06.797833 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-621016af-1be4-4b59-9c4e-1a885db22e3a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.161999 May 16 15:20:06.798397 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 285/572] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:06 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:06.802816 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d3fb1406-3318-426d-9667-cc57d23b0100 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:06.803411 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d3fb1406-3318-426d-9667-cc57d23b0100 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:06.809537 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3fb1406-3318-426d-9667-cc57d23b0100 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.817563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3fb1406-3318-426d-9667-cc57d23b0100 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.817563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3fb1406-3318-426d-9667-cc57d23b0100 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:06.817563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3fb1406-3318-426d-9667-cc57d23b0100 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:06.940275 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d3fb1406-3318-426d-9667-cc57d23b0100 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:06.948638 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d3fb1406-3318-426d-9667-cc57d23b0100 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.149313 May 16 15:20:06.949208 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 286/573] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:06 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:07.155949 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6d0d12a9-f130-4d8c-8c4a-0215f7621f04 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:07.156687 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6d0d12a9-f130-4d8c-8c4a-0215f7621f04 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:07.163489 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d0d12a9-f130-4d8c-8c4a-0215f7621f04 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:07.163987 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d0d12a9-f130-4d8c-8c4a-0215f7621f04 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:07.165295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d0d12a9-f130-4d8c-8c4a-0215f7621f04 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:07.165740 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d0d12a9-f130-4d8c-8c4a-0215f7621f04 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:07.173115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-89c4e224-04e3-482f-bcfc-b6e88b2f82cc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/action" status: 202 len: 0 microversion: 2.20 time: 0.644643 May 16 15:20:07.176878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 288/574] 10.222.0.71 () {62 vars in 1318 bytes} [Mon May 16 15:20:06 2022] POST /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 15:20:07.183473 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:07.184704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:07.191033 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:07.191492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:07.192677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:07.192809 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:07.369326 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6d0d12a9-f130-4d8c-8c4a-0215f7621f04 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:07.372572 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:07.376934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6d0d12a9-f130-4d8c-8c4a-0215f7621f04 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.226189 May 16 15:20:07.377724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 287/575] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:07 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:07.380276 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:07.381757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:07.382932 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3d70967e-6115-43d1-a1e4-9cb5ed824473 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.204921 May 16 15:20:07.383589 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 289/576] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:07 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:07.815096 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8d329de3-1950-4fa9-b8ff-2f081e7a5926 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:07.815736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8d329de3-1950-4fa9-b8ff-2f081e7a5926 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:07.822304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8d329de3-1950-4fa9-b8ff-2f081e7a5926 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:07.822751 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8d329de3-1950-4fa9-b8ff-2f081e7a5926 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:07.823518 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8d329de3-1950-4fa9-b8ff-2f081e7a5926 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:07.823984 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8d329de3-1950-4fa9-b8ff-2f081e7a5926 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:07.952586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-8d329de3-1950-4fa9-b8ff-2f081e7a5926 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:07.959925 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8d329de3-1950-4fa9-b8ff-2f081e7a5926 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.148652 May 16 15:20:07.960635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 288/577] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:07 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:07.966222 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-290b89ce-eae0-4760-9273-1470fe940325 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:07.967029 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-290b89ce-eae0-4760-9273-1470fe940325 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:07.972992 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-290b89ce-eae0-4760-9273-1470fe940325 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:07.973509 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-290b89ce-eae0-4760-9273-1470fe940325 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:07.974252 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-290b89ce-eae0-4760-9273-1470fe940325 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:07.974693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-290b89ce-eae0-4760-9273-1470fe940325 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:08.098745 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-290b89ce-eae0-4760-9273-1470fe940325 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:08.106337 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-290b89ce-eae0-4760-9273-1470fe940325 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.143928 May 16 15:20:08.106898 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 290/578] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:07 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:08.393896 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-bd505185-b2c4-420e-bbf3-30e72da41772 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:08.394435 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-bd505185-b2c4-420e-bbf3-30e72da41772 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:08.401105 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bd505185-b2c4-420e-bbf3-30e72da41772 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.401241 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:08.401644 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bd505185-b2c4-420e-bbf3-30e72da41772 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:08.401740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:08.402294 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bd505185-b2c4-420e-bbf3-30e72da41772 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.402722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bd505185-b2c4-420e-bbf3-30e72da41772 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:08.407990 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.408437 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:08.409204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.409639 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:08.590379 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-bd505185-b2c4-420e-bbf3-30e72da41772 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:08.594390 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:08.597782 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-bd505185-b2c4-420e-bbf3-30e72da41772 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.207812 May 16 15:20:08.598351 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 289/579] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:08 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:08.603435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:08.604971 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:08.606205 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a0542294-8671-4e2a-aaf9-56e1dbd14b78 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.208982 May 16 15:20:08.607015 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 291/580] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:08 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:08.711173 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-b4663c76-8e05-4022-a0e6-10d37820f206 req-9e3f56c7-88bc-4a4b-9ea9-e2d3b477174a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6202deb8-088f-46e8-bd66-7377b00f7305", "name": "network-vif-plugged", "status": "completed", "tag": "15f9e43d-7e6a-475f-922e-a92ad8c84c97"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:08.719112 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-b4663c76-8e05-4022-a0e6-10d37820f206 req-9e3f56c7-88bc-4a4b-9ea9-e2d3b477174a service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.719549 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-b4663c76-8e05-4022-a0e6-10d37820f206 req-9e3f56c7-88bc-4a4b-9ea9-e2d3b477174a service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:08.730605 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-b4663c76-8e05-4022-a0e6-10d37820f206 req-9e3f56c7-88bc-4a4b-9ea9-e2d3b477174a service nova] Creating event network-vif-plugged:15f9e43d-7e6a-475f-922e-a92ad8c84c97 for instance 6202deb8-088f-46e8-bd66-7377b00f7305 on hv-cinder-84175 May 16 15:20:08.735919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-b4663c76-8e05-4022-a0e6-10d37820f206 req-9e3f56c7-88bc-4a4b-9ea9-e2d3b477174a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028540 May 16 15:20:08.736492 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 290/581] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:08.977966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c20bbb66-98bd-4a3c-8bcb-814e87be3aba tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:08.978573 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c20bbb66-98bd-4a3c-8bcb-814e87be3aba tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:08.984555 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c20bbb66-98bd-4a3c-8bcb-814e87be3aba tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.985009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c20bbb66-98bd-4a3c-8bcb-814e87be3aba tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:08.985780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c20bbb66-98bd-4a3c-8bcb-814e87be3aba tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.986217 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c20bbb66-98bd-4a3c-8bcb-814e87be3aba tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:09.110272 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c20bbb66-98bd-4a3c-8bcb-814e87be3aba tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:09.117876 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c20bbb66-98bd-4a3c-8bcb-814e87be3aba tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.144193 May 16 15:20:09.118610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 292/582] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:08 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:09.123928 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f4c875ef-55b1-4902-9063-0c84e382d9d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:09.124629 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f4c875ef-55b1-4902-9063-0c84e382d9d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:09.131079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f4c875ef-55b1-4902-9063-0c84e382d9d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:09.131532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f4c875ef-55b1-4902-9063-0c84e382d9d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:09.132324 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f4c875ef-55b1-4902-9063-0c84e382d9d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:09.132766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f4c875ef-55b1-4902-9063-0c84e382d9d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:09.261971 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f4c875ef-55b1-4902-9063-0c84e382d9d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:09.269453 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f4c875ef-55b1-4902-9063-0c84e382d9d4 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.149760 May 16 15:20:09.270015 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 291/583] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:09 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:09.614279 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a79b4771-645a-43c9-8580-3af14ceddd0b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:09.614934 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a79b4771-645a-43c9-8580-3af14ceddd0b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:09.621791 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a79b4771-645a-43c9-8580-3af14ceddd0b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:09.622241 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a79b4771-645a-43c9-8580-3af14ceddd0b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:09.623010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a79b4771-645a-43c9-8580-3af14ceddd0b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:09.623444 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a79b4771-645a-43c9-8580-3af14ceddd0b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:09.624679 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:09.625281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:09.631408 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:09.631885 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:09.632640 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:09.633732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:09.842722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a79b4771-645a-43c9-8580-3af14ceddd0b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:09.847593 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:09.850204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a79b4771-645a-43c9-8580-3af14ceddd0b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.239781 May 16 15:20:09.850882 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 293/584] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:09 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:09.855999 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:09.857481 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:09.858668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-153f730b-d91b-4377-9967-6e4a1376affb tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.237783 May 16 15:20:09.859210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 292/585] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:09 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:10.135208 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8bb6fa97-7554-4f44-8cea-62810f2533f7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:10.135860 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8bb6fa97-7554-4f44-8cea-62810f2533f7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:10.142377 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8bb6fa97-7554-4f44-8cea-62810f2533f7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:10.142801 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8bb6fa97-7554-4f44-8cea-62810f2533f7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:10.143581 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8bb6fa97-7554-4f44-8cea-62810f2533f7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:10.144043 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8bb6fa97-7554-4f44-8cea-62810f2533f7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:10.287342 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-35f22aa4-789b-4c14-9b0f-8ac3302b8a7d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:10.287998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-35f22aa4-789b-4c14-9b0f-8ac3302b8a7d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:10.294994 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-35f22aa4-789b-4c14-9b0f-8ac3302b8a7d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:10.295459 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-35f22aa4-789b-4c14-9b0f-8ac3302b8a7d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:10.296262 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-35f22aa4-789b-4c14-9b0f-8ac3302b8a7d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:10.296708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-35f22aa4-789b-4c14-9b0f-8ac3302b8a7d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:10.890623 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-35f22aa4-789b-4c14-9b0f-8ac3302b8a7d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:10.899724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-35f22aa4-789b-4c14-9b0f-8ac3302b8a7d tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1523 microversion: 2.1 time: 0.616142 May 16 15:20:10.900507 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 293/586] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:10 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1523 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:10.901757 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8bb6fa97-7554-4f44-8cea-62810f2533f7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:10.905519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6d6d1659-a93e-4fdb-992f-4e1e864eb5e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:10.906035 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6d6d1659-a93e-4fdb-992f-4e1e864eb5e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:10.910415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8bb6fa97-7554-4f44-8cea-62810f2533f7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.779694 May 16 15:20:10.915666 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 294/587] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:10 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:10.915837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d6d1659-a93e-4fdb-992f-4e1e864eb5e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:10.915837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d6d1659-a93e-4fdb-992f-4e1e864eb5e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:10.915837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d6d1659-a93e-4fdb-992f-4e1e864eb5e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:10.915837 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6d6d1659-a93e-4fdb-992f-4e1e864eb5e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:10.917332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:10.918142 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:10.924088 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:10.924544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:10.925396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:10.925839 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:11.197504 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6d6d1659-a93e-4fdb-992f-4e1e864eb5e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:11.204815 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6d6d1659-a93e-4fdb-992f-4e1e864eb5e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.303436 May 16 15:20:11.205456 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 294/588] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:10 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:11.268951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:11.277955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:11.282604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:11.282604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3fe2c079-b0dc-4ce2-bc52-f3fe2a8ec523 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.368152 May 16 15:20:11.282604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 295/589] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:10 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:11.420028 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-b6e584ed-c4c6-4ecb-a08d-1b8ddc6caf84 req-2ef951b6-4f1f-42d6-808a-c73fd02c9c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "005c2b60-9000-4ab7-a297-367fe59e2dfb", "name": "network-vif-deleted", "tag": "d8f457a8-ad98-4eee-b4ce-0e463130c421"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:11.427938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-b6e584ed-c4c6-4ecb-a08d-1b8ddc6caf84 req-2ef951b6-4f1f-42d6-808a-c73fd02c9c90 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:11.428378 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-b6e584ed-c4c6-4ecb-a08d-1b8ddc6caf84 req-2ef951b6-4f1f-42d6-808a-c73fd02c9c90 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:11.438914 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-b6e584ed-c4c6-4ecb-a08d-1b8ddc6caf84 req-2ef951b6-4f1f-42d6-808a-c73fd02c9c90 service nova] Creating event network-vif-deleted:d8f457a8-ad98-4eee-b4ce-0e463130c421 for instance 005c2b60-9000-4ab7-a297-367fe59e2dfb on hv-cinder-84175 May 16 15:20:11.443827 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-b6e584ed-c4c6-4ecb-a08d-1b8ddc6caf84 req-2ef951b6-4f1f-42d6-808a-c73fd02c9c90 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027451 May 16 15:20:11.448870 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 295/590] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:11.916704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-225bf333-4a41-44a0-acf9-522ec0188590 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:11.917316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-225bf333-4a41-44a0-acf9-522ec0188590 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:11.923663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-225bf333-4a41-44a0-acf9-522ec0188590 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:11.924131 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-225bf333-4a41-44a0-acf9-522ec0188590 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:11.924891 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-225bf333-4a41-44a0-acf9-522ec0188590 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:11.925325 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-225bf333-4a41-44a0-acf9-522ec0188590 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:11.929009 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-90125663-4b64-470c-acd4-ca354133f29d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:11.930215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-90125663-4b64-470c-acd4-ca354133f29d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:11.936729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-90125663-4b64-470c-acd4-ca354133f29d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:11.937179 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-90125663-4b64-470c-acd4-ca354133f29d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:11.937945 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-90125663-4b64-470c-acd4-ca354133f29d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:11.938402 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-90125663-4b64-470c-acd4-ca354133f29d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:11.995231 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-225bf333-4a41-44a0-acf9-522ec0188590 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:12.002671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-225bf333-4a41-44a0-acf9-522ec0188590 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1307 microversion: 2.1 time: 0.089767 May 16 15:20:12.003242 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 296/591] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:11 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:12.080882 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-90125663-4b64-470c-acd4-ca354133f29d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:12.088297 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-90125663-4b64-470c-acd4-ca354133f29d tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1362 microversion: 2.1 time: 0.163839 May 16 15:20:12.088863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 296/592] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:11 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:12.222153 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-af7b2d98-a045-4101-af5d-52bdb705b00e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:12.222697 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-af7b2d98-a045-4101-af5d-52bdb705b00e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:12.229197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-af7b2d98-a045-4101-af5d-52bdb705b00e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:12.229650 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-af7b2d98-a045-4101-af5d-52bdb705b00e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:12.230423 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-af7b2d98-a045-4101-af5d-52bdb705b00e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:12.230864 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-af7b2d98-a045-4101-af5d-52bdb705b00e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:12.299775 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:12.300395 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:12.306854 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:12.310298 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:12.311114 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:12.311559 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:12.369246 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-af7b2d98-a045-4101-af5d-52bdb705b00e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:12.376613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-af7b2d98-a045-4101-af5d-52bdb705b00e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.158349 May 16 15:20:12.377412 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 297/593] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:12 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:12.452686 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:12.460302 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:12.461778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:12.462913 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-93a876b6-9e11-4360-bf15-c035e5449f3d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.167091 May 16 15:20:12.463470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 297/594] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:12 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:13.020170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:13.020796 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:13.027769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.028225 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.029009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.029448 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.061621 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.061621 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.062091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lazy-loading 'fault' on Instance uuid 005c2b60-9000-4ab7-a297-367fe59e2dfb {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:13.102636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97021ddaffff4e088961ba1873a8e697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e340fabe31456cb021fcd0b5f505b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:13.105135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-bbcbcfb5-9a84-480d-a005-ffa38ba46d0a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:13.105819 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-bbcbcfb5-9a84-480d-a005-ffa38ba46d0a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:13.110287 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b8153f28-729a-4808-ba4f-e49cf51115c3 tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 200 len: 1312 microversion: 2.1 time: 0.094028 May 16 15:20:13.110861 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 298/595] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:13 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:13.112262 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bbcbcfb5-9a84-480d-a005-ffa38ba46d0a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.112711 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bbcbcfb5-9a84-480d-a005-ffa38ba46d0a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.113488 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bbcbcfb5-9a84-480d-a005-ffa38ba46d0a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.113945 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bbcbcfb5-9a84-480d-a005-ffa38ba46d0a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.242832 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-bbcbcfb5-9a84-480d-a005-ffa38ba46d0a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:13.250918 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-bbcbcfb5-9a84-480d-a005-ffa38ba46d0a tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1548 microversion: 2.1 time: 0.150254 May 16 15:20:13.251496 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 298/596] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:13 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:13.267255 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b060ae19-b8a7-4577-a573-6d93a4c028a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:13.267810 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b060ae19-b8a7-4577-a573-6d93a4c028a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:13.274083 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b060ae19-b8a7-4577-a573-6d93a4c028a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.274467 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b060ae19-b8a7-4577-a573-6d93a4c028a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.275230 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b060ae19-b8a7-4577-a573-6d93a4c028a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.275683 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b060ae19-b8a7-4577-a573-6d93a4c028a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.350357 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b060ae19-b8a7-4577-a573-6d93a4c028a9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086319 May 16 15:20:13.350962 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 299/597] 10.222.0.71 () {58 vars in 1274 bytes} [Mon May 16 15:20:13 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:13.393550 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-170cfaaf-09e8-444c-a1e2-260d938515c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:13.394158 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-170cfaaf-09e8-444c-a1e2-260d938515c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:13.400820 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-170cfaaf-09e8-444c-a1e2-260d938515c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.401281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-170cfaaf-09e8-444c-a1e2-260d938515c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.402030 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-170cfaaf-09e8-444c-a1e2-260d938515c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.402465 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-170cfaaf-09e8-444c-a1e2-260d938515c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.481095 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:13.481708 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:13.487669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.488116 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.488888 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.489337 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.697109 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-170cfaaf-09e8-444c-a1e2-260d938515c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:13.710652 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-170cfaaf-09e8-444c-a1e2-260d938515c5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.320855 May 16 15:20:13.712312 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 299/598] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:13 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:13.744254 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:13.752769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:13.754251 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:13.755419 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-adce560c-d3e5-4d76-9018-946110ba0e22 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.278890 May 16 15:20:13.756213 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 300/599] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:13 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:14.128777 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:14.129771 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] [instance: 005c2b60-9000-4ab7-a297-367fe59e2dfb] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:14.136676 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.137119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.137884 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.138313 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.152252 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] HTTP exception thrown: Instance 005c2b60-9000-4ab7-a297-367fe59e2dfb could not be found. May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Request method failure captured: May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb HTTP/1.1 May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqGYNjACNTPuCxQ5tAZjCeNsclj3zBLZYCT0GzhAYLlpUn7x7SwrEZyHipo_-S1Q3XoVpY2bMG8R1hUmX1nlVK9ChFgSDPfiZHV59Z455s8uTYO82BgZA5rt6rI8q4vWGnMjFPQikO1qUS6XBYaU0uepOS4NRKl-OUss-l4Cc_aveg May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:20:14.153535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1e340fabe31456cb021fcd0b5f505b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1e340fabe31456cb021fcd0b5f505b5"}]}] May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: e1e340fabe31456cb021fcd0b5f505b5 May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1332384991 May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 97021ddaffff4e088961ba1873a8e697 May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1332384991-project May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 005c2b60-9000-4ab7-a297-367fe59e2dfb could not be found. May 16 15:20:14.154797 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '005c2b60-9000-4ab7-a297-367fe59e2dfb'} May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 005c2b60-9000-4ab7-a297-367fe59e2dfb could not be found. May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:14.155533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 005c2b60-9000-4ab7-a297-367fe59e2dfb could not be found. May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 005c2b60-9000-4ab7-a297-367fe59e2dfb could not be found. May 16 15:20:14.156712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:20:14.157711 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] Returning 404 to user: Instance 005c2b60-9000-4ab7-a297-367fe59e2dfb could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:14.157711 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4b644aed-77dc-49e5-8605-9d2edfc6a81a tempest-ServerRescueNegativeTestJSON-1332384991 tempest-ServerRescueNegativeTestJSON-1332384991-project] 10.222.0.71 "GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb" status: 404 len: 111 microversion: 2.1 time: 0.030742 May 16 15:20:14.157711 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 300/600] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:14 2022] GET /compute/v2.1/servers/005c2b60-9000-4ab7-a297-367fe59e2dfb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:20:14.726082 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-70797c2c-1792-4942-b67d-88b3f29a51fc req-1e805d63-846d-4762-b295-415b96e1a352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6202deb8-088f-46e8-bd66-7377b00f7305", "tag": "15f9e43d-7e6a-475f-922e-a92ad8c84c97"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:14.728436 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9cee50bf-e86b-4419-9c95-7258f2c98dda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:14.729387 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9cee50bf-e86b-4419-9c95-7258f2c98dda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:14.735857 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-70797c2c-1792-4942-b67d-88b3f29a51fc req-1e805d63-846d-4762-b295-415b96e1a352 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.736313 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-70797c2c-1792-4942-b67d-88b3f29a51fc req-1e805d63-846d-4762-b295-415b96e1a352 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.736813 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9cee50bf-e86b-4419-9c95-7258f2c98dda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.737566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9cee50bf-e86b-4419-9c95-7258f2c98dda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.738550 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9cee50bf-e86b-4419-9c95-7258f2c98dda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.739190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9cee50bf-e86b-4419-9c95-7258f2c98dda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.750689 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-70797c2c-1792-4942-b67d-88b3f29a51fc req-1e805d63-846d-4762-b295-415b96e1a352 service nova] Creating event network-changed:15f9e43d-7e6a-475f-922e-a92ad8c84c97 for instance 6202deb8-088f-46e8-bd66-7377b00f7305 on hv-cinder-84175 May 16 15:20:14.755791 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-70797c2c-1792-4942-b67d-88b3f29a51fc req-1e805d63-846d-4762-b295-415b96e1a352 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033270 May 16 15:20:14.756397 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 301/601] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:14.776565 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:14.777285 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:14.784565 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.785354 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.788952 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.790378 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:15.011938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9cee50bf-e86b-4419-9c95-7258f2c98dda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:15.022954 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9cee50bf-e86b-4419-9c95-7258f2c98dda tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.298540 May 16 15:20:15.025177 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 301/602] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:14 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:15.089087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:15.100135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:15.101790 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:15.103238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-26f4fd29-046e-471c-9534-ce0429b98b71 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.331964 May 16 15:20:15.107401 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 302/603] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:14 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:16.041679 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4a975f09-0c5e-44f1-95c5-ab951ab0862a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:16.042301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4a975f09-0c5e-44f1-95c5-ab951ab0862a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:16.048725 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a975f09-0c5e-44f1-95c5-ab951ab0862a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:16.059649 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a975f09-0c5e-44f1-95c5-ab951ab0862a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:16.059649 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a975f09-0c5e-44f1-95c5-ab951ab0862a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:16.059649 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a975f09-0c5e-44f1-95c5-ab951ab0862a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:16.122967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:16.123769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:16.136111 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:16.136926 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:16.137944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:16.139289 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:16.325348 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4a975f09-0c5e-44f1-95c5-ab951ab0862a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:16.334965 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4a975f09-0c5e-44f1-95c5-ab951ab0862a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.297716 May 16 15:20:16.345303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 302/604] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:16 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:16.406346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:16.414837 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:16.416481 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:16.417753 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ee846aac-6613-483f-b372-ad5ac0f06b24 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.300164 May 16 15:20:16.418559 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 303/605] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:16 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:16.948878 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-48cacec9-2b77-454b-8f6d-13a5cbc49fbf req-b961052c-eb41-4d3e-9e33-0fbf0c33939e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34eda1a0-162b-4515-b35a-ac5e49da4a9a", "name": "network-vif-plugged", "status": "completed", "tag": "ba75bca4-77b3-4ced-9d61-2fae4f3a831b"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:16.957498 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-48cacec9-2b77-454b-8f6d-13a5cbc49fbf req-b961052c-eb41-4d3e-9e33-0fbf0c33939e service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:16.958037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-48cacec9-2b77-454b-8f6d-13a5cbc49fbf req-b961052c-eb41-4d3e-9e33-0fbf0c33939e service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:16.970685 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-48cacec9-2b77-454b-8f6d-13a5cbc49fbf req-b961052c-eb41-4d3e-9e33-0fbf0c33939e service nova] Creating event network-vif-plugged:ba75bca4-77b3-4ced-9d61-2fae4f3a831b for instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a on hv-cinder-84175 May 16 15:20:16.975338 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-48cacec9-2b77-454b-8f6d-13a5cbc49fbf req-b961052c-eb41-4d3e-9e33-0fbf0c33939e service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031391 May 16 15:20:16.975962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 303/606] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:17.352722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ea1fc02c-0058-43f4-9a01-a98aec776377 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:17.353594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ea1fc02c-0058-43f4-9a01-a98aec776377 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:17.360026 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea1fc02c-0058-43f4-9a01-a98aec776377 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:17.360740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea1fc02c-0058-43f4-9a01-a98aec776377 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:17.361705 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea1fc02c-0058-43f4-9a01-a98aec776377 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:17.362460 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea1fc02c-0058-43f4-9a01-a98aec776377 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:17.437403 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:17.438108 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:17.444250 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:17.444949 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:17.446638 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:17.447274 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:17.641886 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ea1fc02c-0058-43f4-9a01-a98aec776377 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:17.649943 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ea1fc02c-0058-43f4-9a01-a98aec776377 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.301302 May 16 15:20:17.650847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 304/607] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:17 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:17.665367 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:17.673284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:17.674809 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:17.675994 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ee69ec7a-ea3c-42ce-8ab8-edddd19e7a2e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.243269 May 16 15:20:17.676545 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 304/608] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:17 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:18.666369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-25bcab24-f841-4072-9b1c-388c0c771575 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:18.667004 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-25bcab24-f841-4072-9b1c-388c0c771575 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:18.673829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25bcab24-f841-4072-9b1c-388c0c771575 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:18.674361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25bcab24-f841-4072-9b1c-388c0c771575 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:18.675270 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25bcab24-f841-4072-9b1c-388c0c771575 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:18.675808 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25bcab24-f841-4072-9b1c-388c0c771575 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:18.696451 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:18.697816 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:18.704140 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:18.704663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:18.705502 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:18.705994 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:18.874061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-25bcab24-f841-4072-9b1c-388c0c771575 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:18.881559 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-25bcab24-f841-4072-9b1c-388c0c771575 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1367 microversion: 2.1 time: 0.219150 May 16 15:20:18.882392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 305/609] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:18 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:18.888388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:18.897360 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:18.899002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:18.900901 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b47fc0c0-7db9-4e3d-a922-58dce207d5fa tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.207972 May 16 15:20:18.901532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 305/610] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:18 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:19.898403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0c7e6a89-22ae-4055-a739-f6830219078f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:19.899096 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0c7e6a89-22ae-4055-a739-f6830219078f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:19.906231 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c7e6a89-22ae-4055-a739-f6830219078f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:19.906664 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c7e6a89-22ae-4055-a739-f6830219078f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:19.907422 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c7e6a89-22ae-4055-a739-f6830219078f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:19.907882 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c7e6a89-22ae-4055-a739-f6830219078f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:19.918781 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:19.919435 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:19.926543 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:19.926543 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:19.927304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:19.927765 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:20.110442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0c7e6a89-22ae-4055-a739-f6830219078f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:20.117891 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:20.119846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0c7e6a89-22ae-4055-a739-f6830219078f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1557 microversion: 2.1 time: 0.224240 May 16 15:20:20.120712 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 306/611] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:20:19 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:20.126380 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:20.127952 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:20.129093 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0af7f392-41e7-4c10-9f09-de1680dbdaaf tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.214259 May 16 15:20:20.129899 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 306/612] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:19 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:20.137530 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-386a5d6c-a7c0-4df2-a5ad-7cda124e296f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:20.138063 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-386a5d6c-a7c0-4df2-a5ad-7cda124e296f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:20.143873 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-386a5d6c-a7c0-4df2-a5ad-7cda124e296f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:20.144328 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-386a5d6c-a7c0-4df2-a5ad-7cda124e296f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:20.145101 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-386a5d6c-a7c0-4df2-a5ad-7cda124e296f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:20.145535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-386a5d6c-a7c0-4df2-a5ad-7cda124e296f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:20.223288 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-386a5d6c-a7c0-4df2-a5ad-7cda124e296f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091163 May 16 15:20:20.223981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 307/613] 10.222.0.71 () {58 vars in 1274 bytes} [Mon May 16 15:20:20 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:20:21.148192 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:21.148812 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:21.156478 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:21.156890 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:21.157653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:21.158283 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:21.205179 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-7850fa3f-e2cd-4156-83e6-72b8a3792425 req-6ac14b78-959f-4c0c-a057-09fbcc2e2b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34eda1a0-162b-4515-b35a-ac5e49da4a9a", "tag": "ba75bca4-77b3-4ced-9d61-2fae4f3a831b"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:21.219020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-7850fa3f-e2cd-4156-83e6-72b8a3792425 req-6ac14b78-959f-4c0c-a057-09fbcc2e2b04 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:21.220093 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-7850fa3f-e2cd-4156-83e6-72b8a3792425 req-6ac14b78-959f-4c0c-a057-09fbcc2e2b04 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:21.232811 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-7850fa3f-e2cd-4156-83e6-72b8a3792425 req-6ac14b78-959f-4c0c-a057-09fbcc2e2b04 service nova] Creating event network-changed:ba75bca4-77b3-4ced-9d61-2fae4f3a831b for instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a on hv-cinder-84175 May 16 15:20:21.239871 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-7850fa3f-e2cd-4156-83e6-72b8a3792425 req-6ac14b78-959f-4c0c-a057-09fbcc2e2b04 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039110 May 16 15:20:21.241127 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 308/614] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:20:21.336624 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:21.346145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:21.347722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:21.349099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-81c8df52-7152-4965-a85f-ae3f6145a417 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.205101 May 16 15:20:21.359783 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 307/615] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:21 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:22.368473 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:22.369250 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:22.375317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:22.375805 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:22.376567 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:22.376997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:22.506994 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:22.514641 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:22.516145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:22.517307 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b612bcbe-b77e-4c22-b114-f6d8c10d36fd tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.153633 May 16 15:20:22.517860 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 309/616] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:22 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:23.536036 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:23.536644 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:23.543471 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:23.543951 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:23.544709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:23.545139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:23.669637 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:23.677217 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:23.678690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:23.679848 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b6382a30-a749-4630-9558-7d3587f53a03 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.147679 May 16 15:20:23.680399 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 308/617] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:23 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:24.698915 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:24.699538 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:24.705923 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:24.706377 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:24.707187 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:24.707624 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:24.842621 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:24.850514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:24.852031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:24.854404 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ef8988ac-a25c-4cb9-9b00-222f91deb672 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.158926 May 16 15:20:24.855883 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 310/618] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:24 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:25.872727 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:25.873351 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:25.879615 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.880101 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.880870 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.881306 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:26.008580 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:26.017760 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:26.019268 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:26.020757 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5e101e3b-f16e-4922-8658-2a0868f195a1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1744 microversion: 2.20 time: 0.152424 May 16 15:20:26.021619 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 309/619] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:25 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:27.039976 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:27.040612 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:27.047783 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:27.048239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:27.049035 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:27.049479 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:27.177833 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:27.186384 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:27.187987 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:27.189150 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0e7c0114-d210-4ca4-8194-15e2f34b80dc tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1744 microversion: 2.20 time: 0.153226 May 16 15:20:27.189714 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 311/620] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:27 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:28.206267 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:28.206813 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:28.212979 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:28.213433 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:28.214233 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:28.215256 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:28.342526 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:28.350294 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:28.351794 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:28.352935 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c6f14535-95fc-4733-aa81-8d8710079661 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.150625 May 16 15:20:28.353509 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 310/621] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:28 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:29.370797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:29.372280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:29.379551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:29.380137 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:29.380913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:29.381345 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:29.562625 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:29.571917 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:29.576106 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:29.577304 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d53f9219-79bf-4052-986e-d4377b0f8abe tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.210539 May 16 15:20:29.592201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 312/622] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:29 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:30.602127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:30.603306 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:30.611201 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.611911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.613003 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.613587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.825894 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:30.826845 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-a7243384-d2e6-4460-b83d-7c84a295756e req-c33cf602-d437-42f3-a905-a4320ae0f033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6da10c-c8a8-4a5c-aab9-9a507ef24e67", "name": "network-vif-plugged", "status": "completed", "tag": "34cd4358-1a24-49da-a7e4-d4b0049ac593"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:30.838378 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:30.842015 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:30.842854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-a7243384-d2e6-4460-b83d-7c84a295756e req-c33cf602-d437-42f3-a905-a4320ae0f033 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.843318 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-a7243384-d2e6-4460-b83d-7c84a295756e req-c33cf602-d437-42f3-a905-a4320ae0f033 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.846396 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9b6569a6-6ae1-4f08-95fe-6ef33961d019 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.246820 May 16 15:20:30.847163 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 311/623] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:30 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:30.863889 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-a7243384-d2e6-4460-b83d-7c84a295756e req-c33cf602-d437-42f3-a905-a4320ae0f033 service nova] Creating event network-vif-plugged:34cd4358-1a24-49da-a7e4-d4b0049ac593 for instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 on hv-cinder-84175 May 16 15:20:30.877961 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-a7243384-d2e6-4460-b83d-7c84a295756e req-c33cf602-d437-42f3-a905-a4320ae0f033 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054943 May 16 15:20:30.879876 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 313/624] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:20:32.052365 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:32.053519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:32.060558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:32.061007 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:32.062181 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:32.062630 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:32.196316 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:32.205704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:32.207698 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:32.209118 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-342b8ecb-58a1-41f6-a459-2cbae69d5d73 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.346567 May 16 15:20:32.209897 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 312/625] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:31 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:33.228753 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:33.230591 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:33.237310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.238009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.238948 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.239375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.425182 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:33.435573 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:33.437618 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:33.438875 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c1a1b536-83b0-4abd-844a-595db2aceb8c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.214925 May 16 15:20:33.439417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 314/626] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:33 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:34.457654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:34.458266 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:34.474625 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:34.475066 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:34.475872 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:34.476305 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:34.612281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:34.620075 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:34.622341 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:34.623511 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e5c2cbd8-1c43-41da-bcd0-3c0527a1db69 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.169799 May 16 15:20:34.624099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 313/627] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:34 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:35.642088 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:35.643356 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:35.651442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:35.652502 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:35.653693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:35.654137 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:35.826669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:35.837132 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:35.838935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:35.840992 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-633aca46-6d36-41ce-b9ed-00e5ed324d9d tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.202486 May 16 15:20:35.851964 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 315/628] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:35 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:36.859091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:36.860449 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:36.867016 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:36.867472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:36.875711 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:36.876448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:37.020858 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:37.030948 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:37.032516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:37.033751 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9c98e621-d5d2-4bbf-9316-f07ab526a9b5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.179439 May 16 15:20:37.034332 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 314/629] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:36 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:38.052471 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:38.053078 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:38.060645 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:38.061564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:38.062349 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:38.062788 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:38.211179 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:38.221869 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:38.224176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:38.225653 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0e5fa6b1-225c-485b-aba0-7187296ebfa7 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.177018 May 16 15:20:38.226605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 316/630] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:38 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:39.244813 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:39.245429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:39.252588 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:39.253040 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:39.253905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:39.254344 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:39.385085 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:39.392866 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:39.394362 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:39.395521 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b0580c0c-8175-4e7e-9db2-94c0db4aef67 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1739 microversion: 2.20 time: 0.154620 May 16 15:20:39.396377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 315/631] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:39 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:40.413420 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:40.414043 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:40.421055 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:40.421509 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:40.422281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:40.422723 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:40.550122 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:40.558894 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:40.560700 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:40.561813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-71590c4c-075d-477d-82be-099509c229da tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1721 microversion: 2.20 time: 0.152281 May 16 15:20:40.562922 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 317/632] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:40 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:41.580586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:41.581201 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:41.587535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.588027 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.588793 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.589231 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.719596 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:41.727222 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:41.728748 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:41.729895 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5e79a7be-c0cd-4c8d-b7d0-d34e11e34358 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1721 microversion: 2.20 time: 0.153283 May 16 15:20:41.731002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 316/633] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:41 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:42.749181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:42.749804 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:42.756115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.756637 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.757396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.757916 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.897416 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:42.906730 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:42.912874 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:42.912874 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6e7df29d-77d0-430b-af22-24eabc2cb89c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1724 microversion: 2.20 time: 0.164912 May 16 15:20:42.912874 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 318/634] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:42 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:42.928809 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-da94f86e-2c35-4f19-a105-1584074c4bd0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45314336-f103-49f6-bafc-54627d0e1cb0"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:42.929879 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-da94f86e-2c35-4f19-a105-1584074c4bd0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:42.936649 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-da94f86e-2c35-4f19-a105-1584074c4bd0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.937095 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-da94f86e-2c35-4f19-a105-1584074c4bd0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.937861 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-da94f86e-2c35-4f19-a105-1584074c4bd0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.938465 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-da94f86e-2c35-4f19-a105-1584074c4bd0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:43.832214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-da94f86e-2c35-4f19-a105-1584074c4bd0 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.907512 May 16 15:20:43.832897 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 317/635] 10.222.0.71 () {62 vars in 1363 bytes} [Mon May 16 15:20:42 2022] POST /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/os-volume_attachments => generated 188 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:20:43.949177 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5db11266-5068-401c-b516-2f0f5cedd4ea tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:43.950482 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5db11266-5068-401c-b516-2f0f5cedd4ea tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:43.956472 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5db11266-5068-401c-b516-2f0f5cedd4ea tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:43.956927 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5db11266-5068-401c-b516-2f0f5cedd4ea tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:43.957702 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5db11266-5068-401c-b516-2f0f5cedd4ea tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:43.958143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5db11266-5068-401c-b516-2f0f5cedd4ea tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:44.620943 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5db11266-5068-401c-b516-2f0f5cedd4ea tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/os-volume_attachments/45314336-f103-49f6-bafc-54627d0e1cb0" status: 202 len: 0 microversion: 2.20 time: 0.675440 May 16 15:20:44.625182 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 319/636] 10.222.0.71 () {60 vars in 1456 bytes} [Mon May 16 15:20:43 2022] DELETE /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/os-volume_attachments/45314336-f103-49f6-bafc-54627d0e1cb0 => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:20:44.677191 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6b43b1f1-5cb1-4aca-8e20-5a7dc68fcb70 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:44.677774 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6b43b1f1-5cb1-4aca-8e20-5a7dc68fcb70 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:44.685639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6b43b1f1-5cb1-4aca-8e20-5a7dc68fcb70 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:44.685919 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6b43b1f1-5cb1-4aca-8e20-5a7dc68fcb70 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:44.686633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6b43b1f1-5cb1-4aca-8e20-5a7dc68fcb70 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:44.687063 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6b43b1f1-5cb1-4aca-8e20-5a7dc68fcb70 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:44.819008 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-d13da227-2424-44aa-9a0d-f07f545beeb7 req-458c8437-84c9-4a34-9141-c8f60fa58412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6da10c-c8a8-4a5c-aab9-9a507ef24e67", "name": "network-vif-unplugged", "status": "completed", "tag": "34cd4358-1a24-49da-a7e4-d4b0049ac593"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:44.828326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-d13da227-2424-44aa-9a0d-f07f545beeb7 req-458c8437-84c9-4a34-9141-c8f60fa58412 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:44.828775 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-d13da227-2424-44aa-9a0d-f07f545beeb7 req-458c8437-84c9-4a34-9141-c8f60fa58412 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:44.840706 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.compute.server_external_events [req-d13da227-2424-44aa-9a0d-f07f545beeb7 req-458c8437-84c9-4a34-9141-c8f60fa58412 service nova] Unable to find a host for instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67. Dropping event network-vif-unplugged {{(pid=117676) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 15:20:44.848417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-d13da227-2424-44aa-9a0d-f07f545beeb7 req-458c8437-84c9-4a34-9141-c8f60fa58412 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025683 May 16 15:20:44.848417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 320/637] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 16 15:20:44.986045 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6b43b1f1-5cb1-4aca-8e20-5a7dc68fcb70 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "POST /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/action" status: 202 len: 0 microversion: 2.20 time: 0.312968 May 16 15:20:44.986998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 318/638] 10.222.0.71 () {62 vars in 1318 bytes} [Mon May 16 15:20:44 2022] POST /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:20:44.995168 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:44.995829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:45.002473 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:45.002910 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:45.003735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:45.004186 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:45.149831 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:45.158326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:45.160091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:45.176041 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ff0d3bd5-e26f-45a9-bda9-f24b8eb6af5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1672 microversion: 2.20 time: 0.169943 May 16 15:20:45.176041 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 321/639] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:44 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:46.184345 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:46.185252 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:46.191984 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:46.192436 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:46.193209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:46.193687 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:46.326593 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:46.334205 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:46.335716 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:46.336900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e3a0fe8f-3895-4dc2-9ea6-9be7745d6d72 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1672 microversion: 2.20 time: 0.156570 May 16 15:20:46.337464 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 319/640] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:46 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:47.356926 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:47.357534 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:47.364122 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:47.364568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:47.365324 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:47.365756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:47.495043 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:47.501226 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:47.502712 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:47.503897 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-057be017-aaec-4515-a199-971e0e213e11 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.151522 May 16 15:20:47.504459 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 322/641] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:47 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:48.522754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:48.523442 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:48.530392 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.531053 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.531848 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.532358 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.671764 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:48.680037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:48.681514 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:48.682724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-bb317660-7b0b-4947-b690-5497c2430b50 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.164334 May 16 15:20:48.683281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 320/642] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:48 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:49.701359 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:49.701955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:49.708426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:49.708878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:49.709647 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:49.710081 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:49.848040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:49.859478 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:49.861073 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:49.862365 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-86f4d092-34cc-4134-8617-d39f655acbf6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.165391 May 16 15:20:49.862990 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 323/643] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:49 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:50.881846 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:50.882453 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:50.889757 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:50.890199 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:50.890976 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:50.891401 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.036485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:51.046399 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:51.048176 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:51.049654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-db854aea-4c48-4911-826c-04131c723209 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.171588 May 16 15:20:51.050283 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 321/644] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:50 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:51.249038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f9301889-74c6-434f-b8f2-e6defb82dddd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:51.249641 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f9301889-74c6-434f-b8f2-e6defb82dddd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:51.255963 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9301889-74c6-434f-b8f2-e6defb82dddd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:51.256416 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9301889-74c6-434f-b8f2-e6defb82dddd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.257199 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9301889-74c6-434f-b8f2-e6defb82dddd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:51.257639 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9301889-74c6-434f-b8f2-e6defb82dddd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.286791 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f9301889-74c6-434f-b8f2-e6defb82dddd tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/ips" status: 200 len: 145 microversion: 2.1 time: 0.043025 May 16 15:20:51.287672 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 324/645] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:20:51 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:20:52.068734 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:52.069356 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:52.076182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:52.076635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:52.077429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:52.080478 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:52.219442 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:52.227458 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:52.229482 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:52.231612 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-00f1705c-b764-459c-85e7-3f93b6df3ff6 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.166337 May 16 15:20:52.232686 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 322/646] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:52 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:52.894447 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-036e36e2-2672-44a0-ab3b-163076d65eaa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "918cc493-7749-44b6-9a05-fe078d711dc1"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:52.895507 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-036e36e2-2672-44a0-ab3b-163076d65eaa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:52.902802 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-036e36e2-2672-44a0-ab3b-163076d65eaa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:52.903885 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-036e36e2-2672-44a0-ab3b-163076d65eaa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:52.904928 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-036e36e2-2672-44a0-ab3b-163076d65eaa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:52.905371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-036e36e2-2672-44a0-ab3b-163076d65eaa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.250865 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:53.251615 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:53.257857 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.258302 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.259074 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.259506 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.408788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:53.423863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:53.425703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:53.427144 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3f0dfc8a-8e46-4df7-8c06-fcc4e039ec00 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.180222 May 16 15:20:53.439654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 323/647] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:53 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:54.448543 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:54.449277 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:54.457213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.457664 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.458450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.458887 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.602128 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:54.611245 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:54.612990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:54.614145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2ea35d4c-4cde-4253-b55d-4ecb1c0396b2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.169800 May 16 15:20:54.614706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 324/648] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:54 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:55.633707 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:55.634389 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:55.641171 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.641619 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.642401 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.642839 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.793130 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:55.801395 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:55.806653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:55.806653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-eacfc8d5-ef90-4cfb-a2c5-6f339e378162 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.174393 May 16 15:20:55.806653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 325/649] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:55 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:56.822470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:56.823287 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:56.829608 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.830111 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.830832 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.831381 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.255707 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:57.263820 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:57.265361 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:57.266515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f1a27daa-32f8-4067-984f-2ef13540c1ff tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.448064 May 16 15:20:57.267079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 326/650] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:56 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:58.284967 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:58.286207 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:58.292570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.293021 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.294347 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.294888 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.425281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:58.433160 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:58.434653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:58.435842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c9de5ec0-0b5b-4ac4-88d8-59189151a752 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.154757 May 16 15:20:58.436403 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 327/651] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:58 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:20:59.136829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-036e36e2-2672-44a0-ab3b-163076d65eaa tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.246144 May 16 15:20:59.137477 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 325/652] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:20:52 2022] POST /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments => generated 194 bytes in 6248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:59.458252 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:59.458887 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:59.465309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.465748 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.466512 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.467012 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.599407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:59.607327 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:59.609840 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:59.611008 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-dfc8c491-3010-4b48-b9f9-3f7cbb3db0ab tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.156706 May 16 15:20:59.611570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 328/653] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:20:59 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:00.630745 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:00.631481 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:00.637538 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.637986 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:00.638753 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.639188 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:00.769822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:00.777691 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:00.779178 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:00.780393 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-25db391a-a5ae-4198-8bdd-676d2e49ca5b tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.154334 May 16 15:21:00.781023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 326/654] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:00 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:01.798162 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:01.798722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:01.805277 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:01.805732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:01.806511 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:01.806952 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:01.950514 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:01.958947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:01.960486 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:01.961652 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b17d2a6d-163e-4b83-af59-378b54577ed2 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.167679 May 16 15:21:01.962225 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 329/655] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:01 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:02.979615 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:02.980323 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:02.986822 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:02.987269 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:02.988062 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:02.988494 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:03.086880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-350bafe8-b36e-4754-bd39-7003179a2517 req-748b5e21-be2c-4290-85b1-dca1b42eb16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6da10c-c8a8-4a5c-aab9-9a507ef24e67", "name": "network-vif-plugged", "status": "completed", "tag": "34cd4358-1a24-49da-a7e4-d4b0049ac593"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:03.095467 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-350bafe8-b36e-4754-bd39-7003179a2517 req-748b5e21-be2c-4290-85b1-dca1b42eb16d service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:03.096015 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-350bafe8-b36e-4754-bd39-7003179a2517 req-748b5e21-be2c-4290-85b1-dca1b42eb16d service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:03.107095 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-350bafe8-b36e-4754-bd39-7003179a2517 req-748b5e21-be2c-4290-85b1-dca1b42eb16d service nova] Creating event network-vif-plugged:34cd4358-1a24-49da-a7e4-d4b0049ac593 for instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 on hv-cinder-84175 May 16 15:21:03.114037 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-350bafe8-b36e-4754-bd39-7003179a2517 req-748b5e21-be2c-4290-85b1-dca1b42eb16d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157837 May 16 15:21:03.118485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 327/656] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:03.132118 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:03.141135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:03.142635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:03.143818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4006ef03-2f86-463b-b7da-d4271e229e0f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.168063 May 16 15:21:03.144378 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 330/657] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:02 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:04.166393 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:04.167080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:04.174311 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:04.174745 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:04.175504 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:04.175964 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:04.310413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:04.319126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:04.320682 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:04.321845 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-387371d4-bd38-4063-be38-464294a8a06f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.159734 May 16 15:21:04.322409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 328/658] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:04 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:04.974556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-fc0554f3-f481-45cb-ab0e-30732282f89a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:04.975037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-fc0554f3-f481-45cb-ab0e-30732282f89a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:04.980959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc0554f3-f481-45cb-ab0e-30732282f89a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:04.981416 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc0554f3-f481-45cb-ab0e-30732282f89a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:04.982198 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc0554f3-f481-45cb-ab0e-30732282f89a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:04.982630 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc0554f3-f481-45cb-ab0e-30732282f89a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:05.006052 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-fc0554f3-f481-45cb-ab0e-30732282f89a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/ips" status: 200 len: 150 microversion: 2.1 time: 0.138402 May 16 15:21:05.006600 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 331/659] 10.222.0.71 () {58 vars in 1247 bytes} [Mon May 16 15:21:04 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/ips => generated 150 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:05.340776 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:05.341426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:05.348571 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:05.349019 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:05.349787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:05.350220 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:05.477319 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:05.485924 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:05.491880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:05.491880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7b4cedb2-b207-49d6-999e-618ccf91a7c1 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.151871 May 16 15:21:05.491880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 329/660] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:05 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:06.507178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:06.507830 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:06.514413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:06.514901 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:06.516329 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:06.516792 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:06.646974 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:06.654956 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:06.656833 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:06.658182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-10df4348-3f9e-43c4-83c2-dd4bb0fd4d4c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.154939 May 16 15:21:06.658777 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 332/661] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:06 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:07.676966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:07.678022 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:07.685334 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:07.685985 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:07.694688 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:07.694688 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:07.701107 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a5049f5d-6f22-4af7-a34c-281207eeda1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dfbd369-4502-490c-ba7e-eb270b70ab6a"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:07.702222 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a5049f5d-6f22-4af7-a34c-281207eeda1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:07.709539 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a5049f5d-6f22-4af7-a34c-281207eeda1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:07.710222 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a5049f5d-6f22-4af7-a34c-281207eeda1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:07.711007 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a5049f5d-6f22-4af7-a34c-281207eeda1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:07.711445 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a5049f5d-6f22-4af7-a34c-281207eeda1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:07.829550 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:07.838673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:07.840255 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:07.841498 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c256cf8b-ae2c-4f04-9f62-da6f99d79da5 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.169039 May 16 15:21:07.842064 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 330/662] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:07 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:08.619496 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a5049f5d-6f22-4af7-a34c-281207eeda1a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "POST /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.921961 May 16 15:21:08.620153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 333/663] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:21:07 2022] POST /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 194 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:08.840643 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f10514c7-36a8-41d7-88e3-acfb4bc57a16 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:08.841860 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f10514c7-36a8-41d7-88e3-acfb4bc57a16 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:08.851369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f10514c7-36a8-41d7-88e3-acfb4bc57a16 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.851933 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f10514c7-36a8-41d7-88e3-acfb4bc57a16 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.852736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f10514c7-36a8-41d7-88e3-acfb4bc57a16 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.853175 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f10514c7-36a8-41d7-88e3-acfb4bc57a16 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.861526 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:08.863079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:08.869976 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.870459 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.871507 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.872178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.886298 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f10514c7-36a8-41d7-88e3-acfb4bc57a16 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049877 May 16 15:21:08.886865 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 331/664] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:08 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:08.897085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5446385e-0d1a-4af1-894a-7afef2c50be9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:08.897574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5446385e-0d1a-4af1-894a-7afef2c50be9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:08.903677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5446385e-0d1a-4af1-894a-7afef2c50be9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.904139 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5446385e-0d1a-4af1-894a-7afef2c50be9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.904929 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5446385e-0d1a-4af1-894a-7afef2c50be9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.905351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5446385e-0d1a-4af1-894a-7afef2c50be9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.944817 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5446385e-0d1a-4af1-894a-7afef2c50be9 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/918cc493-7749-44b6-9a05-fe078d711dc1" status: 200 len: 194 microversion: 2.1 time: 0.051868 May 16 15:21:08.945474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 332/665] 10.222.0.71 () {58 vars in 1412 bytes} [Mon May 16 15:21:08 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/918cc493-7749-44b6-9a05-fe078d711dc1 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:09.037570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:09.046378 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:09.047985 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:09.049302 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-003a7614-9d35-4b69-a1e3-025ff5426270 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1730 microversion: 2.20 time: 0.192726 May 16 15:21:09.049954 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 334/666] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:08 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:10.068000 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:10.068547 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:10.074758 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:10.075204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:10.075987 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:10.076419 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:10.204115 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:10.212857 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:10.214356 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:10.215514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f3123500-b2db-455c-8696-64248756cb4e tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1717 microversion: 2.20 time: 0.152060 May 16 15:21:10.216113 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 333/667] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:10 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:12.660431 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ab019314-9b26-41a7-ad93-3811996196e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e682a948-a57a-4ae1-81e9-744d06f37823"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:12.662396 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ab019314-9b26-41a7-ad93-3811996196e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:12.669079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ab019314-9b26-41a7-ad93-3811996196e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:12.669459 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ab019314-9b26-41a7-ad93-3811996196e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:12.670272 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ab019314-9b26-41a7-ad93-3811996196e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:12.670707 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ab019314-9b26-41a7-ad93-3811996196e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:13.593333 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ab019314-9b26-41a7-ad93-3811996196e3 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "POST /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936576 May 16 15:21:13.593882 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 335/668] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:21:12 2022] POST /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:19.453856 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c1ceb943-3a84-4b27-a779-f65182fba1a6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:19.454392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c1ceb943-3a84-4b27-a779-f65182fba1a6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:19.461351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c1ceb943-3a84-4b27-a779-f65182fba1a6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.461797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c1ceb943-3a84-4b27-a779-f65182fba1a6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.464176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c1ceb943-3a84-4b27-a779-f65182fba1a6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.464176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c1ceb943-3a84-4b27-a779-f65182fba1a6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.541926 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-c1ceb943-3a84-4b27-a779-f65182fba1a6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lazy-loading 'services' on Instance uuid 34eda1a0-162b-4515-b35a-ac5e49da4a9a {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:19.709692 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c1ceb943-3a84-4b27-a779-f65182fba1a6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments/2dfbd369-4502-490c-ba7e-eb270b70ab6a" status: 202 len: 0 microversion: 2.1 time: 0.259690 May 16 15:21:19.710309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 334/669] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:21:19 2022] DELETE /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments/2dfbd369-4502-490c-ba7e-eb270b70ab6a => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:21:19.720499 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c6ccceba-3c1d-47f3-8ef3-394f5297f413 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:19.721611 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c6ccceba-3c1d-47f3-8ef3-394f5297f413 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:19.728430 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c6ccceba-3c1d-47f3-8ef3-394f5297f413 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.728875 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c6ccceba-3c1d-47f3-8ef3-394f5297f413 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.729638 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c6ccceba-3c1d-47f3-8ef3-394f5297f413 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.730068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c6ccceba-3c1d-47f3-8ef3-394f5297f413 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.759063 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c6ccceba-3c1d-47f3-8ef3-394f5297f413 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 May 16 15:21:19.759613 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 336/670] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:19 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:20.771806 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4ecade88-1b3b-4ebc-9296-ea0af1c671e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:20.772782 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4ecade88-1b3b-4ebc-9296-ea0af1c671e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:20.778907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4ecade88-1b3b-4ebc-9296-ea0af1c671e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:20.779350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4ecade88-1b3b-4ebc-9296-ea0af1c671e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:20.780137 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4ecade88-1b3b-4ebc-9296-ea0af1c671e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:20.780572 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4ecade88-1b3b-4ebc-9296-ea0af1c671e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:20.809252 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4ecade88-1b3b-4ebc-9296-ea0af1c671e2 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 May 16 15:21:20.809804 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 335/671] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:20 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:21.820446 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8823e084-dce2-4137-ac5d-1b037346c07e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:21.821370 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8823e084-dce2-4137-ac5d-1b037346c07e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:21.827581 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8823e084-dce2-4137-ac5d-1b037346c07e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:21.828126 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8823e084-dce2-4137-ac5d-1b037346c07e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:21.828884 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8823e084-dce2-4137-ac5d-1b037346c07e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:21.829323 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8823e084-dce2-4137-ac5d-1b037346c07e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:21.858911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8823e084-dce2-4137-ac5d-1b037346c07e tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042410 May 16 15:21:21.859467 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 337/672] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:21 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:22.871377 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0c29d2ab-df4d-4a3c-ba38-b0439c1eba6b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:22.872350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0c29d2ab-df4d-4a3c-ba38-b0439c1eba6b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:22.878694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c29d2ab-df4d-4a3c-ba38-b0439c1eba6b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:22.879143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c29d2ab-df4d-4a3c-ba38-b0439c1eba6b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:22.879941 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c29d2ab-df4d-4a3c-ba38-b0439c1eba6b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:22.880374 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0c29d2ab-df4d-4a3c-ba38-b0439c1eba6b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:22.909570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0c29d2ab-df4d-4a3c-ba38-b0439c1eba6b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042075 May 16 15:21:22.910118 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 336/673] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:22 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:23.921721 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6cb49f03-a5d1-4b50-a5d6-94ee8e6ba7f9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:23.922641 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6cb49f03-a5d1-4b50-a5d6-94ee8e6ba7f9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:23.929669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6cb49f03-a5d1-4b50-a5d6-94ee8e6ba7f9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:23.930122 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6cb49f03-a5d1-4b50-a5d6-94ee8e6ba7f9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:23.930883 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6cb49f03-a5d1-4b50-a5d6-94ee8e6ba7f9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:23.931318 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6cb49f03-a5d1-4b50-a5d6-94ee8e6ba7f9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:23.960197 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6cb49f03-a5d1-4b50-a5d6-94ee8e6ba7f9 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 May 16 15:21:23.960760 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 338/674] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:23 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:24.971725 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dabe77f6-01b3-4bf5-922f-cb0ff36b5f15 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:24.972654 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dabe77f6-01b3-4bf5-922f-cb0ff36b5f15 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:24.979648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dabe77f6-01b3-4bf5-922f-cb0ff36b5f15 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:24.980109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dabe77f6-01b3-4bf5-922f-cb0ff36b5f15 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:24.980880 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dabe77f6-01b3-4bf5-922f-cb0ff36b5f15 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:24.981342 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dabe77f6-01b3-4bf5-922f-cb0ff36b5f15 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:25.010055 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dabe77f6-01b3-4bf5-922f-cb0ff36b5f15 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042214 May 16 15:21:25.010624 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 337/675] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:24 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:26.021868 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-bb7e7cde-3904-4125-af51-274075f789e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:26.022787 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-bb7e7cde-3904-4125-af51-274075f789e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:26.029331 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bb7e7cde-3904-4125-af51-274075f789e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:26.029791 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bb7e7cde-3904-4125-af51-274075f789e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:26.030561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bb7e7cde-3904-4125-af51-274075f789e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:26.031001 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bb7e7cde-3904-4125-af51-274075f789e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:26.062388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-bb7e7cde-3904-4125-af51-274075f789e7 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 May 16 15:21:26.062946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 339/676] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:26 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:27.074360 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e42490c1-8925-4d72-8a55-08acdeefa454 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:27.075281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e42490c1-8925-4d72-8a55-08acdeefa454 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:27.081637 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e42490c1-8925-4d72-8a55-08acdeefa454 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.082113 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e42490c1-8925-4d72-8a55-08acdeefa454 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.082919 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e42490c1-8925-4d72-8a55-08acdeefa454 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.083689 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e42490c1-8925-4d72-8a55-08acdeefa454 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.111561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e42490c1-8925-4d72-8a55-08acdeefa454 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041157 May 16 15:21:27.112148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 338/677] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:27 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:27.470180 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d6cd9531-a88b-425a-b43e-ea9c017dc31e tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:27.471091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d6cd9531-a88b-425a-b43e-ea9c017dc31e tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:27.478486 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d6cd9531-a88b-425a-b43e-ea9c017dc31e tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.479068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d6cd9531-a88b-425a-b43e-ea9c017dc31e tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.479936 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d6cd9531-a88b-425a-b43e-ea9c017dc31e tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.480368 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d6cd9531-a88b-425a-b43e-ea9c017dc31e tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.509091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d6cd9531-a88b-425a-b43e-ea9c017dc31e tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042802 May 16 15:21:27.509635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 340/678] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:27 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:27.659024 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-acd1db8e-a5cf-44c3-b0c3-e2467ed0cf18 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:27.659437 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-acd1db8e-a5cf-44c3-b0c3-e2467ed0cf18 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:27.666510 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acd1db8e-a5cf-44c3-b0c3-e2467ed0cf18 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.666962 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acd1db8e-a5cf-44c3-b0c3-e2467ed0cf18 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.667769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acd1db8e-a5cf-44c3-b0c3-e2467ed0cf18 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.668209 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acd1db8e-a5cf-44c3-b0c3-e2467ed0cf18 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.697110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-acd1db8e-a5cf-44c3-b0c3-e2467ed0cf18 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/918cc493-7749-44b6-9a05-fe078d711dc1" status: 200 len: 194 microversion: 2.1 time: 0.042087 May 16 15:21:27.697694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 339/679] 10.222.0.71 () {58 vars in 1412 bytes} [Mon May 16 15:21:27 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/918cc493-7749-44b6-9a05-fe078d711dc1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:27.706982 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-44df2ad9-8903-41ab-8d5b-f172e2d4fe99 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:27.708023 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-44df2ad9-8903-41ab-8d5b-f172e2d4fe99 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:27.713787 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-44df2ad9-8903-41ab-8d5b-f172e2d4fe99 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.714238 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-44df2ad9-8903-41ab-8d5b-f172e2d4fe99 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.714990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-44df2ad9-8903-41ab-8d5b-f172e2d4fe99 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.715424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-44df2ad9-8903-41ab-8d5b-f172e2d4fe99 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.792305 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-44df2ad9-8903-41ab-8d5b-f172e2d4fe99 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lazy-loading 'services' on Instance uuid 6202deb8-088f-46e8-bd66-7377b00f7305 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:28.089850 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-44df2ad9-8903-41ab-8d5b-f172e2d4fe99 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/918cc493-7749-44b6-9a05-fe078d711dc1" status: 202 len: 0 microversion: 2.1 time: 0.386422 May 16 15:21:28.090466 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 341/680] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:21:27 2022] DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/918cc493-7749-44b6-9a05-fe078d711dc1 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:21:28.122858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-367809a6-202c-413c-9c06-1f36a10ec53f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:28.127183 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-367809a6-202c-413c-9c06-1f36a10ec53f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:28.130622 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-367809a6-202c-413c-9c06-1f36a10ec53f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:28.131105 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-367809a6-202c-413c-9c06-1f36a10ec53f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:28.131906 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-367809a6-202c-413c-9c06-1f36a10ec53f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:28.132343 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-367809a6-202c-413c-9c06-1f36a10ec53f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:28.162651 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-367809a6-202c-413c-9c06-1f36a10ec53f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043661 May 16 15:21:28.163197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 340/681] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:28 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:29.174464 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-bf121a57-4df3-4ac0-a8c3-89ec00a8380d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:29.175462 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-bf121a57-4df3-4ac0-a8c3-89ec00a8380d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:29.181575 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bf121a57-4df3-4ac0-a8c3-89ec00a8380d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:29.182015 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bf121a57-4df3-4ac0-a8c3-89ec00a8380d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:29.182806 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bf121a57-4df3-4ac0-a8c3-89ec00a8380d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:29.183232 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bf121a57-4df3-4ac0-a8c3-89ec00a8380d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:29.213082 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-bf121a57-4df3-4ac0-a8c3-89ec00a8380d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 May 16 15:21:29.213907 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 342/682] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:29 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:30.225571 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5f07b30a-929c-4ce4-ba0f-4f579ba76d00 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:30.228326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5f07b30a-929c-4ce4-ba0f-4f579ba76d00 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:30.232394 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5f07b30a-929c-4ce4-ba0f-4f579ba76d00 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:30.232843 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5f07b30a-929c-4ce4-ba0f-4f579ba76d00 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:30.233602 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5f07b30a-929c-4ce4-ba0f-4f579ba76d00 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:30.234032 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5f07b30a-929c-4ce4-ba0f-4f579ba76d00 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:30.262951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5f07b30a-929c-4ce4-ba0f-4f579ba76d00 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 May 16 15:21:30.263328 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 341/683] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:30 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:31.274729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-821469b3-378c-46b1-9739-f76fdba0890f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:31.275678 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-821469b3-378c-46b1-9739-f76fdba0890f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:31.282277 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-821469b3-378c-46b1-9739-f76fdba0890f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.282734 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-821469b3-378c-46b1-9739-f76fdba0890f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.283512 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-821469b3-378c-46b1-9739-f76fdba0890f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.283978 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-821469b3-378c-46b1-9739-f76fdba0890f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.315417 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-821469b3-378c-46b1-9739-f76fdba0890f tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044911 May 16 15:21:31.316011 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 343/684] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:31 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:21:31.372136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e3508e00-88db-4e49-a438-b57161e16e27 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:31.372635 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e3508e00-88db-4e49-a438-b57161e16e27 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:31.379076 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3508e00-88db-4e49-a438-b57161e16e27 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.380533 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3508e00-88db-4e49-a438-b57161e16e27 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.381316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3508e00-88db-4e49-a438-b57161e16e27 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.381832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3508e00-88db-4e49-a438-b57161e16e27 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.434234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e3508e00-88db-4e49-a438-b57161e16e27 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:21:31.675818 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e3508e00-88db-4e49-a438-b57161e16e27 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 204 len: 0 microversion: 2.1 time: 0.307103 May 16 15:21:31.677113 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 342/685] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:21:31 2022] DELETE /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:21:31.685345 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1395a708-fb5e-40b2-9559-001f93d1e459 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:31.685957 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1395a708-fb5e-40b2-9559-001f93d1e459 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:31.692509 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1395a708-fb5e-40b2-9559-001f93d1e459 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.693026 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1395a708-fb5e-40b2-9559-001f93d1e459 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.694224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1395a708-fb5e-40b2-9559-001f93d1e459 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.694738 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1395a708-fb5e-40b2-9559-001f93d1e459 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.823474 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1395a708-fb5e-40b2-9559-001f93d1e459 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:31.830814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1395a708-fb5e-40b2-9559-001f93d1e459 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1682 microversion: 2.1 time: 0.149421 May 16 15:21:31.831390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 344/686] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:31 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:32.356948 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-318b700e-928c-4bd9-8f92-e429760ee2b2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:32.361809 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-318b700e-928c-4bd9-8f92-e429760ee2b2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:32.363312 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-318b700e-928c-4bd9-8f92-e429760ee2b2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.363838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-318b700e-928c-4bd9-8f92-e429760ee2b2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.364594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-318b700e-928c-4bd9-8f92-e429760ee2b2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.365026 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-318b700e-928c-4bd9-8f92-e429760ee2b2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.392669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-318b700e-928c-4bd9-8f92-e429760ee2b2 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/e682a948-a57a-4ae1-81e9-744d06f37823" status: 200 len: 194 microversion: 2.1 time: 0.039990 May 16 15:21:32.393281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 343/687] 10.222.0.71 () {58 vars in 1412 bytes} [Mon May 16 15:21:32 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/e682a948-a57a-4ae1-81e9-744d06f37823 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:32.403660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0a9491f1-bcf6-4ceb-8920-f5d315dc8adc tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:32.404148 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0a9491f1-bcf6-4ceb-8920-f5d315dc8adc tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:32.410658 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a9491f1-bcf6-4ceb-8920-f5d315dc8adc tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.411718 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a9491f1-bcf6-4ceb-8920-f5d315dc8adc tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.412483 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a9491f1-bcf6-4ceb-8920-f5d315dc8adc tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.413034 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0a9491f1-bcf6-4ceb-8920-f5d315dc8adc tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.493127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-0a9491f1-bcf6-4ceb-8920-f5d315dc8adc tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lazy-loading 'services' on Instance uuid 6202deb8-088f-46e8-bd66-7377b00f7305 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:32.703382 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0a9491f1-bcf6-4ceb-8920-f5d315dc8adc tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/e682a948-a57a-4ae1-81e9-744d06f37823" status: 202 len: 0 microversion: 2.1 time: 0.303374 May 16 15:21:32.704005 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 345/688] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:21:32 2022] DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments/e682a948-a57a-4ae1-81e9-744d06f37823 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:21:32.847973 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2abe9b37-ad97-4432-baf7-a22b4d4adbd6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:32.848594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2abe9b37-ad97-4432-baf7-a22b4d4adbd6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:32.854533 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2abe9b37-ad97-4432-baf7-a22b4d4adbd6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.855026 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2abe9b37-ad97-4432-baf7-a22b4d4adbd6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.855787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2abe9b37-ad97-4432-baf7-a22b4d4adbd6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.856230 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2abe9b37-ad97-4432-baf7-a22b4d4adbd6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.990485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2abe9b37-ad97-4432-baf7-a22b4d4adbd6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:32.997901 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2abe9b37-ad97-4432-baf7-a22b4d4adbd6 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1682 microversion: 2.1 time: 0.153845 May 16 15:21:32.998466 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 344/689] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:32 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:34.021115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-db43dcca-3ff6-4f93-9a28-5ddf9ac0bc57 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:34.021115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-db43dcca-3ff6-4f93-9a28-5ddf9ac0bc57 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:34.032995 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db43dcca-3ff6-4f93-9a28-5ddf9ac0bc57 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.032995 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db43dcca-3ff6-4f93-9a28-5ddf9ac0bc57 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.032995 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db43dcca-3ff6-4f93-9a28-5ddf9ac0bc57 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.032995 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db43dcca-3ff6-4f93-9a28-5ddf9ac0bc57 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.257412 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-db43dcca-3ff6-4f93-9a28-5ddf9ac0bc57 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:34.265008 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-db43dcca-3ff6-4f93-9a28-5ddf9ac0bc57 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1682 microversion: 2.1 time: 0.252164 May 16 15:21:34.265624 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 346/690] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:34 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:34.794094 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-d5041cae-9a16-4c42-98a2-29ac6f4acbe4 req-1cfcf874-18ab-4842-8b15-84524e321b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34eda1a0-162b-4515-b35a-ac5e49da4a9a", "name": "network-vif-deleted", "tag": "ba75bca4-77b3-4ced-9d61-2fae4f3a831b"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:34.804047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-d5041cae-9a16-4c42-98a2-29ac6f4acbe4 req-1cfcf874-18ab-4842-8b15-84524e321b51 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.804473 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-d5041cae-9a16-4c42-98a2-29ac6f4acbe4 req-1cfcf874-18ab-4842-8b15-84524e321b51 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.817433 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-d5041cae-9a16-4c42-98a2-29ac6f4acbe4 req-1cfcf874-18ab-4842-8b15-84524e321b51 service nova] Creating event network-vif-deleted:ba75bca4-77b3-4ced-9d61-2fae4f3a831b for instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a on hv-cinder-84175 May 16 15:21:34.830819 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-d5041cae-9a16-4c42-98a2-29ac6f4acbe4 req-1cfcf874-18ab-4842-8b15-84524e321b51 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106022 May 16 15:21:34.836350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 345/691] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:34.934089 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-649537a8-7930-4c1b-97c0-900798d01aa7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:34.935357 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-649537a8-7930-4c1b-97c0-900798d01aa7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:34.941974 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-649537a8-7930-4c1b-97c0-900798d01aa7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.942615 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-649537a8-7930-4c1b-97c0-900798d01aa7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.944139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-649537a8-7930-4c1b-97c0-900798d01aa7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.944745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-649537a8-7930-4c1b-97c0-900798d01aa7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.979693 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-649537a8-7930-4c1b-97c0-900798d01aa7 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049008 May 16 15:21:34.984757 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 347/692] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:34 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:21:35.097873 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-138750b3-0ba2-49a6-bf37-4b0cbbe12661 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:35.099369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-138750b3-0ba2-49a6-bf37-4b0cbbe12661 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:35.105744 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-138750b3-0ba2-49a6-bf37-4b0cbbe12661 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.106600 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-138750b3-0ba2-49a6-bf37-4b0cbbe12661 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.107617 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-138750b3-0ba2-49a6-bf37-4b0cbbe12661 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.108139 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-138750b3-0ba2-49a6-bf37-4b0cbbe12661 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.141934 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-138750b3-0ba2-49a6-bf37-4b0cbbe12661 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048196 May 16 15:21:35.147750 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 346/693] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:21:35 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:21:35.205503 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-285bf005-ca09-4ace-a2f5-53a16e11abeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:35.206083 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-285bf005-ca09-4ace-a2f5-53a16e11abeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:35.212352 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-285bf005-ca09-4ace-a2f5-53a16e11abeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.212799 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-285bf005-ca09-4ace-a2f5-53a16e11abeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.213572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-285bf005-ca09-4ace-a2f5-53a16e11abeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.214000 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-285bf005-ca09-4ace-a2f5-53a16e11abeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.238833 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-285bf005-ca09-4ace-a2f5-53a16e11abeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:21:35.282509 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:35.283170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:35.289300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.289756 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.290541 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.290977 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.327399 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.327800 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.328257 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lazy-loading 'fault' on Instance uuid 34eda1a0-162b-4515-b35a-ac5e49da4a9a {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:35.373535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:35.381601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-bc45ff5f-865a-4cbb-a170-b15b7ea63800 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1331 microversion: 2.1 time: 0.103122 May 16 15:21:35.382253 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 347/694] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:35 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:35.522036 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-285bf005-ca09-4ace-a2f5-53a16e11abeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 204 len: 0 microversion: 2.1 time: 0.319469 May 16 15:21:35.522863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 348/695] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:21:35 2022] DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:21:35.531442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2acaafd8-94ec-4f3a-985c-feba46473fed tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:35.536013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2acaafd8-94ec-4f3a-985c-feba46473fed tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:35.543328 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2acaafd8-94ec-4f3a-985c-feba46473fed tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.543817 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2acaafd8-94ec-4f3a-985c-feba46473fed tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.544792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2acaafd8-94ec-4f3a-985c-feba46473fed tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.545385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2acaafd8-94ec-4f3a-985c-feba46473fed tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.697080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2acaafd8-94ec-4f3a-985c-feba46473fed tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:35.705189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2acaafd8-94ec-4f3a-985c-feba46473fed tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1672 microversion: 2.1 time: 0.178098 May 16 15:21:35.706204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 348/696] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:35 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:36.399927 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:36.400637 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:36.406783 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.407230 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.408035 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.408546 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.439869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.440319 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.440766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lazy-loading 'fault' on Instance uuid 34eda1a0-162b-4515-b35a-ac5e49da4a9a {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:36.482128 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38cdf40e33b47d8aa79e029cded7503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ba8d3ade6e4efd90ce4c340464c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:36.489351 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-dab5d0b0-1580-43f2-bc6d-32a6ceb58ac5 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 200 len: 1331 microversion: 2.1 time: 0.094854 May 16 15:21:36.490281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 349/697] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:36 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:36.722275 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f2f59d61-02ad-49fa-a781-e2299364e7e0 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:36.722892 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f2f59d61-02ad-49fa-a781-e2299364e7e0 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:36.729530 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f2f59d61-02ad-49fa-a781-e2299364e7e0 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.729976 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f2f59d61-02ad-49fa-a781-e2299364e7e0 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.730746 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f2f59d61-02ad-49fa-a781-e2299364e7e0 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.731186 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f2f59d61-02ad-49fa-a781-e2299364e7e0 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.864292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f2f59d61-02ad-49fa-a781-e2299364e7e0 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:36.873380 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f2f59d61-02ad-49fa-a781-e2299364e7e0 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1672 microversion: 2.1 time: 0.154713 May 16 15:21:36.873770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 349/698] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:36 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:37.507152 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:37.507813 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:37.514295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.515021 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:37.515911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.516549 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:37.531556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a HTTP/1.1 May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:37.533582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:37.534958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '34eda1a0-162b-4515-b35a-ac5e49da4a9a'} May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:37.535753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:37.537119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:37.538483 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:37.538483 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c135fb96-d9bb-4202-9194-f73bb0cc6762 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 404 len: 111 microversion: 2.1 time: 0.032604 May 16 15:21:37.538483 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 350/699] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:37 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:37.544174 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-27d7eac3-d847-4690-b2f6-811c3da33a3a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '.version_select at 0x7f0c83697040>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:37.634253 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-27d7eac3-d847-4690-b2f6-811c3da33a3a tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765210552" status: 202 len: 0 microversion: 2.1 time: 0.093769 May 16 15:21:37.634753 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 350/700] 10.222.0.71 () {58 vars in 1220 bytes} [Mon May 16 15:21:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765210552 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:21:37.890237 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9fbd168e-171d-40a2-ae37-e6c015e7d2e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:37.891214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9fbd168e-171d-40a2-ae37-e6c015e7d2e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:37.898011 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9fbd168e-171d-40a2-ae37-e6c015e7d2e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.898510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9fbd168e-171d-40a2-ae37-e6c015e7d2e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:37.899244 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9fbd168e-171d-40a2-ae37-e6c015e7d2e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.899655 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9fbd168e-171d-40a2-ae37-e6c015e7d2e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.170349 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9fbd168e-171d-40a2-ae37-e6c015e7d2e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.179557 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9fbd168e-171d-40a2-ae37-e6c015e7d2e1 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1672 microversion: 2.1 time: 0.293116 May 16 15:21:38.181440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 351/701] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:37 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1672 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:38.815673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-1470f050-aaaa-4d47-a3a0-5ec1be39f736 req-0b2be369-5bcd-4239-b1d0-4fa49a2d505f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6202deb8-088f-46e8-bd66-7377b00f7305", "name": "network-vif-deleted", "tag": "15f9e43d-7e6a-475f-922e-a92ad8c84c97"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:38.824719 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-1470f050-aaaa-4d47-a3a0-5ec1be39f736 req-0b2be369-5bcd-4239-b1d0-4fa49a2d505f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.825466 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-1470f050-aaaa-4d47-a3a0-5ec1be39f736 req-0b2be369-5bcd-4239-b1d0-4fa49a2d505f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.836955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-1470f050-aaaa-4d47-a3a0-5ec1be39f736 req-0b2be369-5bcd-4239-b1d0-4fa49a2d505f service nova] Creating event network-vif-deleted:15f9e43d-7e6a-475f-922e-a92ad8c84c97 for instance 6202deb8-088f-46e8-bd66-7377b00f7305 on hv-cinder-84175 May 16 15:21:38.842175 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-1470f050-aaaa-4d47-a3a0-5ec1be39f736 req-0b2be369-5bcd-4239-b1d0-4fa49a2d505f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031010 May 16 15:21:38.843668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 351/702] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:39.197123 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:39.198363 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:39.211061 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.212176 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.230137 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.230730 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.272127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.272507 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.272962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lazy-loading 'fault' on Instance uuid 6202deb8-088f-46e8-bd66-7377b00f7305 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:39.314668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426aa73007cd4ca3b8c165b87f69c02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9886c48c5650408cacaa4e7f78586404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.323399 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-fdc34516-1835-4bbe-9f21-1b6a0e986c15 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 200 len: 1327 microversion: 2.1 time: 0.130323 May 16 15:21:39.324043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 352/703] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:39 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:39.972699 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:39.973412 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:39.979967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.980413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.981385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.982085 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.996571 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a HTTP/1.1 May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:39.998198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:39.999784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '34eda1a0-162b-4515-b35a-ac5e49da4a9a'} May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:40.000729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:40.002108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.003655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:40.003655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-95464ef4-ae5b-4427-b33b-36cf96037a1c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 404 len: 111 microversion: 2.1 time: 0.031999 May 16 15:21:40.003655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 352/704] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:21:39 2022] DELETE /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:40.009551 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.010168 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 34eda1a0-162b-4515-b35a-ac5e49da4a9a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:40.021133 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.021133 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.021133 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.021133 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.031107 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a HTTP/1.1 May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:40.032759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:40.034548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '34eda1a0-162b-4515-b35a-ac5e49da4a9a'} May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:40.035394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. May 16 15:21:40.037394 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:40.039010 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance 34eda1a0-162b-4515-b35a-ac5e49da4a9a could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:40.039010 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5f5bfce8-7e5b-469a-b694-a6954af6be86 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a" status: 404 len: 111 microversion: 2.1 time: 0.029334 May 16 15:21:40.039010 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 353/705] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:40 2022] GET /compute/v2.1/servers/34eda1a0-162b-4515-b35a-ac5e49da4a9a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:40.344125 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.344125 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:40.348235 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.348685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.349450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.349916 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.364240 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] HTTP exception thrown: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Request method failure captured: May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 HTTP/1.1 May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmrLB5xOfRztZVakFMBawRxQHhYxucjWEjkdMZvxGHRU_hR_Mq0Uqvt0O3YOIuKVDYJv_4MhNcxLGVqZywPNJMluHGCnsX62qeHlMLqoGfrigWeIRVesLvs3JRUPAYWZxICz71D_vpSnTRaq9oJEBdgixCtjoBcI9fgseAP8L_MgPwk May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:40.365738 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9886c48c5650408cacaa4e7f78586404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}] May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 426aa73007cd4ca3b8c165b87f69c02e May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:40.367234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '6202deb8-088f-46e8-bd66-7377b00f7305'} May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:40.368245 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:40.369780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:40.371264 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Returning 404 to user: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:40.371264 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f25f3f61-af70-430c-b224-1ffea86bc819 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 404 len: 111 microversion: 2.1 time: 0.029942 May 16 15:21:40.371264 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 353/706] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:40 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:40.380675 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-35316d64-8b8c-4d7b-9505-180e3da0a54b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '.version_select at 0x7f0c83712820>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.456783 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-35316d64-8b8c-4d7b-9505-180e3da0a54b tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459007666" status: 202 len: 0 microversion: 2.1 time: 0.079805 May 16 15:21:40.457369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 354/707] 10.222.0.71 () {58 vars in 1217 bytes} [Mon May 16 15:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459007666 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:21:41.309957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:41.310456 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:41.317235 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.317679 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.318535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.319018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.332198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a HTTP/1.1 May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:41.333726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.342417 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'e13d168b-75a6-49ab-a169-a941b031915a'} May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:41.343409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.344778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.347581 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:41.347581 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-767be983-3918-44d9-8655-3e474420742c tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 404 len: 111 microversion: 2.1 time: 0.029596 May 16 15:21:41.347581 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 354/708] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:21:41 2022] DELETE /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:41.348040 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:41.348040 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: e13d168b-75a6-49ab-a169-a941b031915a] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:41.354646 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.355095 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.355990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.356408 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.370618 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a HTTP/1.1 May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:41.372209 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.373790 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': 'e13d168b-75a6-49ab-a169-a941b031915a'} May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:41.377874 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. May 16 15:21:41.379284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.382057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance e13d168b-75a6-49ab-a169-a941b031915a could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:41.382057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a4a17eb7-569c-4dd2-aed8-6b80f3e6c9f4 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a" status: 404 len: 111 microversion: 2.1 time: 0.033392 May 16 15:21:41.382057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 355/709] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:41 2022] GET /compute/v2.1/servers/e13d168b-75a6-49ab-a169-a941b031915a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:41.382637 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:41.382637 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:41.388838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.389302 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.390135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.390579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.405240 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d HTTP/1.1 May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:41.406779 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.408134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '71e20c89-9049-4b13-a531-2c2e361ed84d'} May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:41.408908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.410031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:41.411294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:41.411294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cb089401-8be9-4ce7-a96d-ca1730cd8ebf tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 404 len: 111 microversion: 2.1 time: 0.029947 May 16 15:21:41.411294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 355/710] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:21:41 2022] DELETE /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:41.419469 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:41.420157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: 71e20c89-9049-4b13-a531-2c2e361ed84d] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:41.426642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.427090 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.427888 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.428400 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.442132 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d HTTP/1.1 May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:41.446743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.448281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '71e20c89-9049-4b13-a531-2c2e361ed84d'} May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:41.449127 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. May 16 15:21:41.450538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:41.451989 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance 71e20c89-9049-4b13-a531-2c2e361ed84d could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:41.451989 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-292e9b41-e171-4e90-ac55-a7f840cff50b tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d" status: 404 len: 111 microversion: 2.1 time: 0.029559 May 16 15:21:41.451989 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 356/711] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:41 2022] GET /compute/v2.1/servers/71e20c89-9049-4b13-a531-2c2e361ed84d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:42.767024 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:42.767541 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:42.774612 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.775053 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.775834 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.776264 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.790823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 HTTP/1.1 May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:42.792361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.793832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'a4b1e4cf-ff7e-43d2-9351-ca6206651db4'} May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:42.794726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.795957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:42.797189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:42.797189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1d58f742-236f-4c52-ae85-e2368e24909d tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 404 len: 111 microversion: 2.1 time: 0.030549 May 16 15:21:42.797189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 356/712] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:21:42 2022] DELETE /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:42.801938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:42.802591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] [instance: a4b1e4cf-ff7e-43d2-9351-ca6206651db4] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:42.808932 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.809386 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.810151 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.810589 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.823532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] HTTP exception thrown: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Request method failure captured: May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 HTTP/1.1 May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqNGGMQTpW8q5mhZLgLok2RfRFhfuxw34K9Y-QDVT9BhPxfACSpVSSfzC45_-Dme4ddprGrVUWlUi1Bvp6ApMhnixmp-_OE2USyWpYzEjrCSNWcoSt8G40XMh8zRhdB4qnGc_aowBqFja30XysRqeLWA6P8xw_rDK8gcwAwWa7JnGw May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:42.825048 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_56ba8d3ade6e4efd90ce4c340464c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/56ba8d3ade6e4efd90ce4c340464c565"}]}] May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 56ba8d3ade6e4efd90ce4c340464c565 May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-891417504 May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: d38cdf40e33b47d8aa79e029cded7503 May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeNegativeTest-891417504-project May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.826531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': 'a4b1e4cf-ff7e-43d2-9351-ca6206651db4'} May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:42.827424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. May 16 15:21:42.828669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:42.829676 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] Returning 404 to user: Instance a4b1e4cf-ff7e-43d2-9351-ca6206651db4 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:42.829676 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4186b97b-6070-48da-8d7c-755c7fb2e697 tempest-AttachVolumeNegativeTest-891417504 tempest-AttachVolumeNegativeTest-891417504-project] 10.222.0.71 "GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4" status: 404 len: 111 microversion: 2.1 time: 0.028304 May 16 15:21:42.829676 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 357/713] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:42 2022] GET /compute/v2.1/servers/a4b1e4cf-ff7e-43d2-9351-ca6206651db4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:21:45.775955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:45.776505 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:45.783050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.783495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.784294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.784727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.799516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] HTTP exception thrown: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Request method failure captured: May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 HTTP/1.1 May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmrLB5xOfRztZVakFMBawRxQHhYxucjWEjkdMZvxGHRU_hR_Mq0Uqvt0O3YOIuKVDYJv_4MhNcxLGVqZywPNJMluHGCnsX62qeHlMLqoGfrigWeIRVesLvs3JRUPAYWZxICz71D_vpSnTRaq9oJEBdgixCtjoBcI9fgseAP8L_MgPwk May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:45.801091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9886c48c5650408cacaa4e7f78586404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}] May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 426aa73007cd4ca3b8c165b87f69c02e May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.802663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '6202deb8-088f-46e8-bd66-7377b00f7305'} May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:45.806636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.808018 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:45.809407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Returning 404 to user: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:45.809407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5892a4c0-92f3-4671-b664-fbd49c050476 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 404 len: 111 microversion: 2.1 time: 0.031491 May 16 15:21:45.809407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 357/714] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:21:45 2022] DELETE /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:21:45.813358 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:45.814068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: 6202deb8-088f-46e8-bd66-7377b00f7305] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:45.821431 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.821971 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.822824 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.823331 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.840654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] HTTP exception thrown: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Request method failure captured: May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 HTTP/1.1 May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmrLB5xOfRztZVakFMBawRxQHhYxucjWEjkdMZvxGHRU_hR_Mq0Uqvt0O3YOIuKVDYJv_4MhNcxLGVqZywPNJMluHGCnsX62qeHlMLqoGfrigWeIRVesLvs3JRUPAYWZxICz71D_vpSnTRaq9oJEBdgixCtjoBcI9fgseAP8L_MgPwk May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:45.842293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9886c48c5650408cacaa4e7f78586404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}] May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 426aa73007cd4ca3b8c165b87f69c02e May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.843542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '6202deb8-088f-46e8-bd66-7377b00f7305'} May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:45.844303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. May 16 15:21:45.845844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:45.847193 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Returning 404 to user: Instance 6202deb8-088f-46e8-bd66-7377b00f7305 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:45.847193 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4d4e4a0d-998c-4c30-a606-94d47044a692 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305" status: 404 len: 111 microversion: 2.1 time: 0.035654 May 16 15:21:45.847193 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 358/715] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:45 2022] GET /compute/v2.1/servers/6202deb8-088f-46e8-bd66-7377b00f7305 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:21:47.158232 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:47.158781 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:47.166150 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.170499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.170499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.170499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.182141 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] HTTP exception thrown: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Request method failure captured: May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 HTTP/1.1 May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmrLB5xOfRztZVakFMBawRxQHhYxucjWEjkdMZvxGHRU_hR_Mq0Uqvt0O3YOIuKVDYJv_4MhNcxLGVqZywPNJMluHGCnsX62qeHlMLqoGfrigWeIRVesLvs3JRUPAYWZxICz71D_vpSnTRaq9oJEBdgixCtjoBcI9fgseAP8L_MgPwk May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:47.183698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9886c48c5650408cacaa4e7f78586404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}] May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 426aa73007cd4ca3b8c165b87f69c02e May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.185039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'ccced799-d35d-4fcc-81d1-df03942c2394'} May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:47.185914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.187192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:47.188967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Returning 404 to user: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:47.188967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1d470701-ae86-4c71-9803-f0ce8bbaceeb tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 404 len: 111 microversion: 2.1 time: 0.030843 May 16 15:21:47.188967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 358/716] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:21:47 2022] DELETE /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:47.193836 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:47.197407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] [instance: ccced799-d35d-4fcc-81d1-df03942c2394] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:47.200612 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.201067 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.201834 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.202266 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.216766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] HTTP exception thrown: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Request method failure captured: May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 HTTP/1.1 May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmrLB5xOfRztZVakFMBawRxQHhYxucjWEjkdMZvxGHRU_hR_Mq0Uqvt0O3YOIuKVDYJv_4MhNcxLGVqZywPNJMluHGCnsX62qeHlMLqoGfrigWeIRVesLvs3JRUPAYWZxICz71D_vpSnTRaq9oJEBdgixCtjoBcI9fgseAP8L_MgPwk May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:47.218295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9886c48c5650408cacaa4e7f78586404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9886c48c5650408cacaa4e7f78586404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9886c48c5650408cacaa4e7f78586404"}]}] May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 9886c48c5650408cacaa4e7f78586404 May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2106875596 May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 426aa73007cd4ca3b8c165b87f69c02e May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeTestJSON-2106875596-project May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.219873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': 'ccced799-d35d-4fcc-81d1-df03942c2394'} May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:47.221099 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. May 16 15:21:47.222343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:47.223366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] Returning 404 to user: Instance ccced799-d35d-4fcc-81d1-df03942c2394 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:47.223366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-dcd2f365-0ba4-49e7-ae9a-38b945b40032 tempest-AttachVolumeTestJSON-2106875596 tempest-AttachVolumeTestJSON-2106875596-project] 10.222.0.71 "GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394" status: 404 len: 111 microversion: 2.1 time: 0.029706 May 16 15:21:47.223366 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 359/717] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:21:47 2022] GET /compute/v2.1/servers/ccced799-d35d-4fcc-81d1-df03942c2394 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:21:48.534942 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-39a1054a-8b8b-44c6-95b3-b14bb38265f9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:48.536014 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-39a1054a-8b8b-44c6-95b3-b14bb38265f9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:48.543051 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-39a1054a-8b8b-44c6-95b3-b14bb38265f9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.543585 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-39a1054a-8b8b-44c6-95b3-b14bb38265f9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.544516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-39a1054a-8b8b-44c6-95b3-b14bb38265f9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.545242 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-39a1054a-8b8b-44c6-95b3-b14bb38265f9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.579887 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-39a1054a-8b8b-44c6-95b3-b14bb38265f9 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049963 May 16 15:21:48.580454 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 359/718] 10.222.0.71 () {60 vars in 1342 bytes} [Mon May 16 15:21:48 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:48.649839 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0fb178b3-1356-4a1b-b8bc-f3c24278674a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:48.650673 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0fb178b3-1356-4a1b-b8bc-f3c24278674a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:48.657476 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0fb178b3-1356-4a1b-b8bc-f3c24278674a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.658042 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0fb178b3-1356-4a1b-b8bc-f3c24278674a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.659033 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0fb178b3-1356-4a1b-b8bc-f3c24278674a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.659542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0fb178b3-1356-4a1b-b8bc-f3c24278674a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.686835 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0fb178b3-1356-4a1b-b8bc-f3c24278674a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:21:49.038066 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0fb178b3-1356-4a1b-b8bc-f3c24278674a tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 204 len: 0 microversion: 2.20 time: 0.392995 May 16 15:21:49.039592 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 360/719] 10.222.0.71 () {60 vars in 1279 bytes} [Mon May 16 15:21:48 2022] DELETE /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:21:49.048170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:49.049032 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:49.055767 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.056207 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:49.056988 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.057432 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:49.202997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:49.222079 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:49.224172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:49.225371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a7b0c79f-abd7-4b07-908e-7e69f3cb3496 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.181712 May 16 15:21:49.237237 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 360/720] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:49 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:50.253524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:50.253524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:50.263044 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:50.263597 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:50.265102 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:50.265606 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:50.691102 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:50.701490 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:50.704095 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:50.705713 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-88b0ac15-186a-4829-bb7e-2c45ab65b923 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1723 microversion: 2.20 time: 0.459951 May 16 15:21:50.706578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 361/721] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:50 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:51.649341 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-594e1c96-a51b-4010-8b02-b5290ccc8b9d req-80c62850-3787-40b5-ab2f-2d94995d9657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6da10c-c8a8-4a5c-aab9-9a507ef24e67", "name": "network-vif-deleted", "tag": "34cd4358-1a24-49da-a7e4-d4b0049ac593"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:51.663234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-594e1c96-a51b-4010-8b02-b5290ccc8b9d req-80c62850-3787-40b5-ab2f-2d94995d9657 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.665108 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-594e1c96-a51b-4010-8b02-b5290ccc8b9d req-80c62850-3787-40b5-ab2f-2d94995d9657 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.680387 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-594e1c96-a51b-4010-8b02-b5290ccc8b9d req-80c62850-3787-40b5-ab2f-2d94995d9657 service nova] Creating event network-vif-deleted:34cd4358-1a24-49da-a7e4-d4b0049ac593 for instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 on hv-cinder-84175 May 16 15:21:51.687855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-594e1c96-a51b-4010-8b02-b5290ccc8b9d req-80c62850-3787-40b5-ab2f-2d94995d9657 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043372 May 16 15:21:51.689172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 361/722] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:51.725248 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:51.729091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:51.743539 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.744237 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.746115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.749947 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.915402 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.923944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.928675 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b559cc982a846bea7f7f2077b7c455b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64990eb359b54b0a8636a6e7619800a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.930732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0fbc1d1d-8fe1-4844-9f8d-5df6964ca644 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 200 len: 1655 microversion: 2.20 time: 0.210111 May 16 15:21:51.931292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 362/723] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:51 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 1655 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:52.950357 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:52.951091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:52.957964 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.958549 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.959516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.960210 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.974456 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] HTTP exception thrown: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Request method failure captured: May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 HTTP/1.1 May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqTQgvaFhTvoYDUgHRqRP-poyEsVSsVVthqsruAXPsRz_jXjyy1A1RQxJOtvJURnbZMeeUpqqXVOF5Gl-dK5lhaiER_Vp6m4Xg08uD12ZqI905IYLSbyZmS5HhwqnpaA40YuXgZsTu30RaRh8bEpnfCU_8wuItSQVtffxw0jaTzin4 May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:52.976429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}] May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 7b559cc982a846bea7f7f2077b7c455b May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:52.977829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '0e6da10c-c8a8-4a5c-aab9-9a507ef24e67'} May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:52.978540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:52.979727 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:52.983130 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Returning 404 to user: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:52.984607 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f7ba6bc4-62a2-4815-a272-f3466dd6471f tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 404 len: 111 microversion: 2.20 time: 0.037592 May 16 15:21:52.985435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 362/724] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:52 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:21:52.993953 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3131f612-bad8-4e94-9634-5c6ca579fae3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '.version_select at 0x7f0c83611160>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:53.076759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3131f612-bad8-4e94-9634-5c6ca579fae3 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-797413150" status: 204 len: 0 microversion: 2.20 time: 0.081506 May 16 15:21:53.077455 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 363/725] 10.222.0.71 () {60 vars in 1258 bytes} [Mon May 16 15:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-797413150 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 16 15:21:55.256867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:55.257375 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:55.263914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:55.264368 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:55.265150 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:55.265592 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:55.279270 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] HTTP exception thrown: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Request method failure captured: May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: DELETE /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 HTTP/1.1 May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqTQgvaFhTvoYDUgHRqRP-poyEsVSsVVthqsruAXPsRz_jXjyy1A1RQxJOtvJURnbZMeeUpqqXVOF5Gl-dK5lhaiER_Vp6m4Xg08uD12ZqI905IYLSbyZmS5HhwqnpaA40YuXgZsTu30RaRh8bEpnfCU_8wuItSQVtffxw0jaTzin4 May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:55.280939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}] May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 7b559cc982a846bea7f7f2077b7c455b May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.282503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '0e6da10c-c8a8-4a5c-aab9-9a507ef24e67'} May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:55.283392 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.284838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:55.286181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Returning 404 to user: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:55.286181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f40c312e-14a7-48bc-88aa-f6bf1ac192ac tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 404 len: 111 microversion: 2.20 time: 0.029482 May 16 15:21:55.286181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 363/726] 10.222.0.71 () {60 vars in 1279 bytes} [Mon May 16 15:21:55 2022] DELETE /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:21:55.292243 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:55.292866 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:55.299425 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:55.299909 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:55.300680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:55.301121 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:55.315325 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] HTTP exception thrown: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Request method failure captured: May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 HTTP/1.1 May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqTQgvaFhTvoYDUgHRqRP-poyEsVSsVVthqsruAXPsRz_jXjyy1A1RQxJOtvJURnbZMeeUpqqXVOF5Gl-dK5lhaiER_Vp6m4Xg08uD12ZqI905IYLSbyZmS5HhwqnpaA40YuXgZsTu30RaRh8bEpnfCU_8wuItSQVtffxw0jaTzin4 May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:55.317006 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}] May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 7b559cc982a846bea7f7f2077b7c455b May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.318737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '0e6da10c-c8a8-4a5c-aab9-9a507ef24e67'} May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:55.319585 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. May 16 15:21:55.321548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:55.322922 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Returning 404 to user: Instance 0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:55.322922 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-51bd0e7d-97f9-45ad-b305-58678adeddf4 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67" status: 404 len: 111 microversion: 2.20 time: 0.031488 May 16 15:21:55.322922 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 364/727] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:55 2022] GET /compute/v2.1/servers/0e6da10c-c8a8-4a5c-aab9-9a507ef24e67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:21:55.975853 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3932fb2d-52dc-487e-b278-47cc673dd2e0 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c836ef550>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:56.022495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3932fb2d-52dc-487e-b278-47cc673dd2e0 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/93dc6755-2d8f-4a5b-8e75-6a9a642188ba" status: 200 len: 351 microversion: 2.1 time: 0.050319 May 16 15:21:56.029572 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 364/728] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:21:55 2022] GET /compute/v2.1/os-volumes/93dc6755-2d8f-4a5b-8e75-6a9a642188ba => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:56.613603 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:56.614310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:56.627374 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.629100 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.630082 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.633426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.652376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] HTTP exception thrown: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Request method failure captured: May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: DELETE /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f HTTP/1.1 May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmqTQgvaFhTvoYDUgHRqRP-poyEsVSsVVthqsruAXPsRz_jXjyy1A1RQxJOtvJURnbZMeeUpqqXVOF5Gl-dK5lhaiER_Vp6m4Xg08uD12ZqI905IYLSbyZmS5HhwqnpaA40YuXgZsTu30RaRh8bEpnfCU_8wuItSQVtffxw0jaTzin4 May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:21:56.654125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}] May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 7b559cc982a846bea7f7f2077b7c455b May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.655821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '893feede-4052-4c51-96a2-1f93510d1f5f'} May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:56.656708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.658633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:21:56.661782 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Returning 404 to user: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:56.662906 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e43d7976-21b9-4892-ab62-c128e931d82c tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "DELETE /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 404 len: 111 microversion: 2.20 time: 0.053201 May 16 15:21:56.664470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 365/729] 10.222.0.71 () {60 vars in 1279 bytes} [Mon May 16 15:21:56 2022] DELETE /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:21:56.675489 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:56.676227 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] [instance: 893feede-4052-4c51-96a2-1f93510d1f5f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:56.686856 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.691178 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.697199 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.697744 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.713231 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] HTTP exception thrown: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Request method failure captured: May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f HTTP/1.1 May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmqTQgvaFhTvoYDUgHRqRP-poyEsVSsVVthqsruAXPsRz_jXjyy1A1RQxJOtvJURnbZMeeUpqqXVOF5Gl-dK5lhaiER_Vp6m4Xg08uD12ZqI905IYLSbyZmS5HhwqnpaA40YuXgZsTu30RaRh8bEpnfCU_8wuItSQVtffxw0jaTzin4 May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:21:56.714862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_64990eb359b54b0a8636a6e7619800a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/64990eb359b54b0a8636a6e7619800a7"}]}] May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 64990eb359b54b0a8636a6e7619800a7 May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-726042705 May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 7b559cc982a846bea7f7f2077b7c455b May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-726042705-project May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.718265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '893feede-4052-4c51-96a2-1f93510d1f5f'} May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:56.719059 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. May 16 15:21:56.720273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:21:56.721326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] Returning 404 to user: Instance 893feede-4052-4c51-96a2-1f93510d1f5f could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:56.721326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-bfe7ca95-f383-4bd1-92c3-65b2bb387e61 tempest-AttachVolumeShelveTestJSON-726042705 tempest-AttachVolumeShelveTestJSON-726042705-project] 10.222.0.71 "GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f" status: 404 len: 111 microversion: 2.20 time: 0.048135 May 16 15:21:56.722486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 365/730] 10.222.0.71 () {60 vars in 1276 bytes} [Mon May 16 15:21:56 2022] GET /compute/v2.1/servers/893feede-4052-4c51-96a2-1f93510d1f5f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:21:57.758455 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c2b4798c-6403-4303-81bf-bb1ec9ea9979 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c8362f160>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:57.811748 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c2b4798c-6403-4303-81bf-bb1ec9ea9979 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/d2305839-7c86-4ae6-b036-64fdac6c8424" status: 200 len: 351 microversion: 2.1 time: 0.057361 May 16 15:21:57.812322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 366/731] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:21:57 2022] GET /compute/v2.1/os-volumes/d2305839-7c86-4ae6-b036-64fdac6c8424 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:59.564524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3b86b916-85e8-405d-b632-c37090646817 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c836ef940>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:59.621783 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3b86b916-85e8-405d-b632-c37090646817 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/ef84f801-2eb1-4fa2-90da-6e21585794f9" status: 200 len: 349 microversion: 2.1 time: 0.061612 May 16 15:21:59.622356 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 366/732] 10.222.0.71 () {58 vars in 1244 bytes} [Mon May 16 15:21:59 2022] GET /compute/v2.1/os-volumes/ef84f801-2eb1-4fa2-90da-6e21585794f9 => generated 349 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:59.633473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-93a7cc74-1e0b-4142-b2c9-347f7c6da203 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c837121f0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:59.725258 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-93a7cc74-1e0b-4142-b2c9-347f7c6da203 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095626 May 16 15:21:59.726522 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 367/733] 10.222.0.71 () {58 vars in 1133 bytes} [Mon May 16 15:21:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:59.739739 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6e5db45f-c8f8-4f6e-b07f-72be6d398644 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c8364d1f0>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:59.828310 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6e5db45f-c8f8-4f6e-b07f-72be6d398644 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.093680 May 16 15:21:59.829325 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 367/734] 10.222.0.71 () {58 vars in 1148 bytes} [Mon May 16 15:21:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:59.842507 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ebebfc42-5d3a-40f0-8aa8-f85ef483ceef tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c880dc550>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:59.935799 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ebebfc42-5d3a-40f0-8aa8-f85ef483ceef tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097172 May 16 15:21:59.936440 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 368/735] 10.222.0.71 () {58 vars in 1133 bytes} [Mon May 16 15:21:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:59.957265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4fdefd57-6054-4a1c-8a88-01de62a4dfdb tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c836efe50>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:00.031855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4fdefd57-6054-4a1c-8a88-01de62a4dfdb tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088092 May 16 15:22:00.047211 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 368/736] 10.222.0.71 () {58 vars in 1166 bytes} [Mon May 16 15:21:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:00.048960 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7fa2ba94-6b88-4948-b2a1-4904b70b1dba tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c8372aee0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:00.180869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7fa2ba94-6b88-4948-b2a1-4904b70b1dba tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.133556 May 16 15:22:00.180869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 369/737] 10.222.0.71 () {58 vars in 1169 bytes} [Mon May 16 15:22:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:00.192234 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-143ff68c-6bcb-46a0-8647-c9ea3aab1f68 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c88115b80>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:00.348720 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-143ff68c-6bcb-46a0-8647-c9ea3aab1f68 tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.154153 May 16 15:22:00.348720 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 369/738] 10.222.0.71 () {58 vars in 1154 bytes} [Mon May 16 15:22:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:00.356645 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-443720bf-d77f-4859-8926-694f30ba7b9f tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c88274ca0>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:00.472435 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-443720bf-d77f-4859-8926-694f30ba7b9f tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.120317 May 16 15:22:00.480362 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 370/739] 10.222.0.71 () {58 vars in 1187 bytes} [Mon May 16 15:22:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:00.485109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-aadc1a51-751a-4842-8467-894a5c7e1c7c tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] Calling method '.version_select at 0x7f0c8364d550>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:00.576952 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-aadc1a51-751a-4842-8467-894a5c7e1c7c tempest-VolumesTestJSON-936571397 tempest-VolumesTestJSON-936571397-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.095554 May 16 15:22:00.577527 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 370/740] 10.222.0.71 () {58 vars in 1154 bytes} [Mon May 16 15:22:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:03.384137 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1754486386", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:03.453813 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] validate_networks() for None {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:22:03.753115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:22:03.755736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:22:03.755736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:22:03.755736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:22:03.755736 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:22:03.765133 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:03.765579 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:03.766374 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:03.766814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:03.786178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Getting quotas for project 8141ea82ed35431693530da3cf074b46. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:22:03.790766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Getting quotas for user d0154612674d46c8ae3f75ff3aef4a00 and project 8141ea82ed35431693530da3cf074b46. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:22:03.801551 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:22:03.803828 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:22:03.916766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-cecf0f9e-c818-4958-bc9c-b126d7fedf24 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541931 May 16 15:22:03.917315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 371/741] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:22:03.927899 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-11fc0a3e-b1b2-48cb-9b85-e794fdd8e1f3 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:03.928544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-11fc0a3e-b1b2-48cb-9b85-e794fdd8e1f3 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:03.984676 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-11fc0a3e-b1b2-48cb-9b85-e794fdd8e1f3 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:03.991073 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-11fc0a3e-b1b2-48cb-9b85-e794fdd8e1f3 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1215 microversion: 2.1 time: 0.067495 May 16 15:22:03.992235 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 371/742] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:03 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:05.009881 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0b18bbef-6a6c-4974-a159-d6d7be452361 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:05.010538 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0b18bbef-6a6c-4974-a159-d6d7be452361 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:05.070677 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0b18bbef-6a6c-4974-a159-d6d7be452361 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:05.078372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0b18bbef-6a6c-4974-a159-d6d7be452361 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1215 microversion: 2.1 time: 0.073196 May 16 15:22:05.079041 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 372/743] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:05 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:06.096090 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-11144325-84bb-4679-b214-76963d0e32dd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:06.097477 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-11144325-84bb-4679-b214-76963d0e32dd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:06.111056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-11144325-84bb-4679-b214-76963d0e32dd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:06.112594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-11144325-84bb-4679-b214-76963d0e32dd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:06.112913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-11144325-84bb-4679-b214-76963d0e32dd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:06.113669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-11144325-84bb-4679-b214-76963d0e32dd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:06.191110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-11144325-84bb-4679-b214-76963d0e32dd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:06.199744 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-11144325-84bb-4679-b214-76963d0e32dd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1267 microversion: 2.1 time: 0.107671 May 16 15:22:06.200318 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 372/744] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:06 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:07.221811 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8620ea7f-d631-4513-81d6-8afdd460f1a8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:07.222423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8620ea7f-d631-4513-81d6-8afdd460f1a8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:07.233261 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8620ea7f-d631-4513-81d6-8afdd460f1a8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:07.236542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8620ea7f-d631-4513-81d6-8afdd460f1a8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.237510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8620ea7f-d631-4513-81d6-8afdd460f1a8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:07.240416 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8620ea7f-d631-4513-81d6-8afdd460f1a8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.332397 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-8620ea7f-d631-4513-81d6-8afdd460f1a8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:07.344958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8620ea7f-d631-4513-81d6-8afdd460f1a8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1273 microversion: 2.1 time: 0.126763 May 16 15:22:07.345547 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 373/745] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:07 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:08.364974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-eb250265-18dd-4eda-85e5-756d9fc2f500 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:08.365622 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-eb250265-18dd-4eda-85e5-756d9fc2f500 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:08.373406 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-eb250265-18dd-4eda-85e5-756d9fc2f500 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.373862 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-eb250265-18dd-4eda-85e5-756d9fc2f500 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.374823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-eb250265-18dd-4eda-85e5-756d9fc2f500 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.375394 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-eb250265-18dd-4eda-85e5-756d9fc2f500 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.591135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-eb250265-18dd-4eda-85e5-756d9fc2f500 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:08.606228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-eb250265-18dd-4eda-85e5-756d9fc2f500 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.245513 May 16 15:22:08.622951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 373/746] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:08 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:08.880893 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-f2df3c06-1138-43b2-8160-476bfb2ef4a9 req-daa70d96-101c-4619-926f-321e6eb3ec24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a06833b-64cb-4d38-af44-a65846042bb0", "tag": "9af33f98-ef87-4f7d-8fea-7a4afdb56c74"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:08.894465 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-f2df3c06-1138-43b2-8160-476bfb2ef4a9 req-daa70d96-101c-4619-926f-321e6eb3ec24 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.894914 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-f2df3c06-1138-43b2-8160-476bfb2ef4a9 req-daa70d96-101c-4619-926f-321e6eb3ec24 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.907052 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-f2df3c06-1138-43b2-8160-476bfb2ef4a9 req-daa70d96-101c-4619-926f-321e6eb3ec24 service nova] Creating event network-changed:9af33f98-ef87-4f7d-8fea-7a4afdb56c74 for instance 1a06833b-64cb-4d38-af44-a65846042bb0 on hv-cinder-84175 May 16 15:22:08.912211 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-f2df3c06-1138-43b2-8160-476bfb2ef4a9 req-daa70d96-101c-4619-926f-321e6eb3ec24 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035083 May 16 15:22:08.913131 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 374/747] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:09.623924 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-12308d63-c5e5-4e78-886a-cb4d0ac7b704 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:09.625419 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-12308d63-c5e5-4e78-886a-cb4d0ac7b704 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:09.633579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-12308d63-c5e5-4e78-886a-cb4d0ac7b704 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:09.634259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-12308d63-c5e5-4e78-886a-cb4d0ac7b704 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:09.635154 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-12308d63-c5e5-4e78-886a-cb4d0ac7b704 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:09.635894 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-12308d63-c5e5-4e78-886a-cb4d0ac7b704 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:09.785347 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-12308d63-c5e5-4e78-886a-cb4d0ac7b704 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:09.795053 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-12308d63-c5e5-4e78-886a-cb4d0ac7b704 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.175251 May 16 15:22:09.795710 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 374/748] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:09 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:10.813318 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-01450849-87db-4ad2-afd0-e8b663c8326e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:10.814091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-01450849-87db-4ad2-afd0-e8b663c8326e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:10.820303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-01450849-87db-4ad2-afd0-e8b663c8326e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:10.820745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-01450849-87db-4ad2-afd0-e8b663c8326e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:10.821510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-01450849-87db-4ad2-afd0-e8b663c8326e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:10.821939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-01450849-87db-4ad2-afd0-e8b663c8326e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:10.971692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-01450849-87db-4ad2-afd0-e8b663c8326e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:10.978969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-01450849-87db-4ad2-afd0-e8b663c8326e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.170195 May 16 15:22:10.979555 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 375/749] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:10 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:11.997752 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e3b6ecba-bd25-45d8-a89f-40aa0af8c2cc tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:11.997752 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e3b6ecba-bd25-45d8-a89f-40aa0af8c2cc tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:12.003803 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3b6ecba-bd25-45d8-a89f-40aa0af8c2cc tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:12.004252 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3b6ecba-bd25-45d8-a89f-40aa0af8c2cc tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:12.005020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3b6ecba-bd25-45d8-a89f-40aa0af8c2cc tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:12.005448 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3b6ecba-bd25-45d8-a89f-40aa0af8c2cc tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:12.147566 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e3b6ecba-bd25-45d8-a89f-40aa0af8c2cc tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:12.155751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e3b6ecba-bd25-45d8-a89f-40aa0af8c2cc tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.162631 May 16 15:22:12.165527 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 375/750] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:11 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:13.173132 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-81eed5de-f970-4679-a850-205cae19f9fd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:13.174194 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-81eed5de-f970-4679-a850-205cae19f9fd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:13.182896 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-81eed5de-f970-4679-a850-205cae19f9fd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:13.183426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-81eed5de-f970-4679-a850-205cae19f9fd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:13.199985 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-81eed5de-f970-4679-a850-205cae19f9fd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:13.200298 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-81eed5de-f970-4679-a850-205cae19f9fd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:13.400256 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-81eed5de-f970-4679-a850-205cae19f9fd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:13.407654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-81eed5de-f970-4679-a850-205cae19f9fd tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.238513 May 16 15:22:13.408275 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 376/751] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:13 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:14.425461 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8a5372e1-4e23-425b-8eda-614c416ddb73 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:14.426280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8a5372e1-4e23-425b-8eda-614c416ddb73 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:14.433453 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8a5372e1-4e23-425b-8eda-614c416ddb73 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:14.434016 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8a5372e1-4e23-425b-8eda-614c416ddb73 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:14.436037 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8a5372e1-4e23-425b-8eda-614c416ddb73 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:14.440623 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8a5372e1-4e23-425b-8eda-614c416ddb73 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:14.586534 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8a5372e1-4e23-425b-8eda-614c416ddb73 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:14.593939 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8a5372e1-4e23-425b-8eda-614c416ddb73 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.172815 May 16 15:22:14.594502 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 376/752] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:14 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:15.612144 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3754f0eb-e60c-4432-a051-ece650d039d8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:15.612755 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3754f0eb-e60c-4432-a051-ece650d039d8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:15.619618 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3754f0eb-e60c-4432-a051-ece650d039d8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.620149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3754f0eb-e60c-4432-a051-ece650d039d8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.620908 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3754f0eb-e60c-4432-a051-ece650d039d8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.621336 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3754f0eb-e60c-4432-a051-ece650d039d8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.775988 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3754f0eb-e60c-4432-a051-ece650d039d8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:15.783717 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3754f0eb-e60c-4432-a051-ece650d039d8 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.175312 May 16 15:22:15.793667 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 377/753] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:15 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:16.800624 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-48fd41e7-f005-43ae-9f88-2b277535e1d0 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:16.801238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-48fd41e7-f005-43ae-9f88-2b277535e1d0 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:16.808480 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48fd41e7-f005-43ae-9f88-2b277535e1d0 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.808932 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48fd41e7-f005-43ae-9f88-2b277535e1d0 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.809927 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48fd41e7-f005-43ae-9f88-2b277535e1d0 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.810575 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-48fd41e7-f005-43ae-9f88-2b277535e1d0 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.948336 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-48fd41e7-f005-43ae-9f88-2b277535e1d0 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:16.955913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-48fd41e7-f005-43ae-9f88-2b277535e1d0 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.158987 May 16 15:22:16.956495 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 377/754] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:16 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:17.973000 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-fc614257-03be-4da3-ba48-55a53f09492a tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:17.973619 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-fc614257-03be-4da3-ba48-55a53f09492a tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:17.981565 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-27c3fe16-1f08-4198-b089-5c62378d2fdc req-9774a0bd-a2c6-4eee-8e00-c38423175d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a06833b-64cb-4d38-af44-a65846042bb0", "name": "network-vif-plugged", "status": "completed", "tag": "9af33f98-ef87-4f7d-8fea-7a4afdb56c74"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:17.983434 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc614257-03be-4da3-ba48-55a53f09492a tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.984853 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc614257-03be-4da3-ba48-55a53f09492a tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.986676 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc614257-03be-4da3-ba48-55a53f09492a tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.987717 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc614257-03be-4da3-ba48-55a53f09492a tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.993329 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-27c3fe16-1f08-4198-b089-5c62378d2fdc req-9774a0bd-a2c6-4eee-8e00-c38423175d7b service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.993909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-27c3fe16-1f08-4198-b089-5c62378d2fdc req-9774a0bd-a2c6-4eee-8e00-c38423175d7b service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.008056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-27c3fe16-1f08-4198-b089-5c62378d2fdc req-9774a0bd-a2c6-4eee-8e00-c38423175d7b service nova] Creating event network-vif-plugged:9af33f98-ef87-4f7d-8fea-7a4afdb56c74 for instance 1a06833b-64cb-4d38-af44-a65846042bb0 on hv-cinder-84175 May 16 15:22:18.013175 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-27c3fe16-1f08-4198-b089-5c62378d2fdc req-9774a0bd-a2c6-4eee-8e00-c38423175d7b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036450 May 16 15:22:18.013770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 378/755] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:18.162221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-fc614257-03be-4da3-ba48-55a53f09492a tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:18.170280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-fc614257-03be-4da3-ba48-55a53f09492a tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.201109 May 16 15:22:18.170814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 378/756] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:17 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:19.187966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0e6072a9-a2b9-4cc7-a877-b2c83a84af86 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:19.188579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0e6072a9-a2b9-4cc7-a877-b2c83a84af86 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:19.195907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e6072a9-a2b9-4cc7-a877-b2c83a84af86 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.196486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e6072a9-a2b9-4cc7-a877-b2c83a84af86 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.197338 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e6072a9-a2b9-4cc7-a877-b2c83a84af86 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.197783 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e6072a9-a2b9-4cc7-a877-b2c83a84af86 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.333378 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0e6072a9-a2b9-4cc7-a877-b2c83a84af86 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:19.341352 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0e6072a9-a2b9-4cc7-a877-b2c83a84af86 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1315 microversion: 2.1 time: 0.158183 May 16 15:22:19.341913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 379/757] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:19 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:20.359011 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-91d8ab37-fd0c-4b88-bf52-352b46727481 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.359454 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-91d8ab37-fd0c-4b88-bf52-352b46727481 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.365576 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-91d8ab37-fd0c-4b88-bf52-352b46727481 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.365973 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-91d8ab37-fd0c-4b88-bf52-352b46727481 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.366743 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-91d8ab37-fd0c-4b88-bf52-352b46727481 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.367753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-91d8ab37-fd0c-4b88-bf52-352b46727481 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.513410 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-91d8ab37-fd0c-4b88-bf52-352b46727481 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.521772 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-91d8ab37-fd0c-4b88-bf52-352b46727481 tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1465 microversion: 2.1 time: 0.166996 May 16 15:22:20.522450 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 379/758] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:20 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:20.561470 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-936aa6b9-d395-4e28-88ff-ee7bf1f3494e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.562525 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-936aa6b9-d395-4e28-88ff-ee7bf1f3494e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.569005 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-936aa6b9-d395-4e28-88ff-ee7bf1f3494e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.569462 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-936aa6b9-d395-4e28-88ff-ee7bf1f3494e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.570290 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-936aa6b9-d395-4e28-88ff-ee7bf1f3494e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.570725 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-936aa6b9-d395-4e28-88ff-ee7bf1f3494e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.596421 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-936aa6b9-d395-4e28-88ff-ee7bf1f3494e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:22:20.875613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-936aa6b9-d395-4e28-88ff-ee7bf1f3494e tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "DELETE /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 204 len: 0 microversion: 2.1 time: 0.317619 May 16 15:22:20.878749 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 380/759] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:22:20 2022] DELETE /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:22:20.885370 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f881d84b-03f4-4506-a4a8-73735d4af1cf tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.886103 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f881d84b-03f4-4506-a4a8-73735d4af1cf tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.892012 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f881d84b-03f4-4506-a4a8-73735d4af1cf tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.892578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f881d84b-03f4-4506-a4a8-73735d4af1cf tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.893433 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f881d84b-03f4-4506-a4a8-73735d4af1cf tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.893963 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f881d84b-03f4-4506-a4a8-73735d4af1cf tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.031503 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f881d84b-03f4-4506-a4a8-73735d4af1cf tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:21.038788 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f881d84b-03f4-4506-a4a8-73735d4af1cf tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1471 microversion: 2.1 time: 0.157290 May 16 15:22:21.039539 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 380/760] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:20 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:22.056944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3aeba99c-1dea-40b9-86f1-988b5be724ab tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:22.057745 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3aeba99c-1dea-40b9-86f1-988b5be724ab tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:22.064005 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3aeba99c-1dea-40b9-86f1-988b5be724ab tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.066320 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3aeba99c-1dea-40b9-86f1-988b5be724ab tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.066320 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3aeba99c-1dea-40b9-86f1-988b5be724ab tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.066320 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3aeba99c-1dea-40b9-86f1-988b5be724ab tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.233330 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3aeba99c-1dea-40b9-86f1-988b5be724ab tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:22.240730 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3aeba99c-1dea-40b9-86f1-988b5be724ab tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1471 microversion: 2.1 time: 0.188622 May 16 15:22:22.241286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 381/761] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:22 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:23.021214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-2bbada9c-8ec4-4cfe-8bd9-5897c100e16b req-3f9ac076-8789-4412-84c9-152a512692ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a06833b-64cb-4d38-af44-a65846042bb0", "name": "network-vif-deleted", "tag": "9af33f98-ef87-4f7d-8fea-7a4afdb56c74"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:23.032228 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-2bbada9c-8ec4-4cfe-8bd9-5897c100e16b req-3f9ac076-8789-4412-84c9-152a512692ce service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.033132 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-2bbada9c-8ec4-4cfe-8bd9-5897c100e16b req-3f9ac076-8789-4412-84c9-152a512692ce service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.056469 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-2bbada9c-8ec4-4cfe-8bd9-5897c100e16b req-3f9ac076-8789-4412-84c9-152a512692ce service nova] Creating event network-vif-deleted:9af33f98-ef87-4f7d-8fea-7a4afdb56c74 for instance 1a06833b-64cb-4d38-af44-a65846042bb0 on hv-cinder-84175 May 16 15:22:23.062164 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-2bbada9c-8ec4-4cfe-8bd9-5897c100e16b req-3f9ac076-8789-4412-84c9-152a512692ce service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044643 May 16 15:22:23.069276 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 381/762] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:23.261191 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-570add5d-3c52-42df-95d4-5c64e9d00ced tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:23.262369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-570add5d-3c52-42df-95d4-5c64e9d00ced tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:23.269020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-570add5d-3c52-42df-95d4-5c64e9d00ced tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.269020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-570add5d-3c52-42df-95d4-5c64e9d00ced tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.269807 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-570add5d-3c52-42df-95d4-5c64e9d00ced tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.270239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-570add5d-3c52-42df-95d4-5c64e9d00ced tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.335749 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-570add5d-3c52-42df-95d4-5c64e9d00ced tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0154612674d46c8ae3f75ff3aef4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8141ea82ed35431693530da3cf074b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.343091 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-570add5d-3c52-42df-95d4-5c64e9d00ced tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 200 len: 1300 microversion: 2.1 time: 0.086380 May 16 15:22:23.343671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 382/763] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:23 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:24.363435 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:24.364165 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] [instance: 1a06833b-64cb-4d38-af44-a65846042bb0] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:24.371007 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.371395 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.372196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.372641 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.385986 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] HTTP exception thrown: Instance 1a06833b-64cb-4d38-af44-a65846042bb0 could not be found. May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Request method failure captured: May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 HTTP/1.1 May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmwZx_S_4cnR5h9NCaLBHzuKO04cwBBq0s_uFjiE6tkXE8HgIJd46eafcxxeGYBRgwDtSpOw_Ruknnj8t4fxd8j-Nv4y07PfBF8PzcAQlnrEorJRVr1RUIFN_bZR0W5YWggeyt1oGPZ5_4DdvBRFamKom6Esn6ZwwPGpFsOhfzJF4bo May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 8141ea82ed35431693530da3cf074b46 May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-VolumesNegativeTest-1448645500 May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:22:24.387621 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8141ea82ed35431693530da3cf074b46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8141ea82ed35431693530da3cf074b46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8141ea82ed35431693530da3cf074b46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8141ea82ed35431693530da3cf074b46"}]}] May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-VolumesNegativeTest-1448645500 May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 8141ea82ed35431693530da3cf074b46 May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-VolumesNegativeTest-1448645500 May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-VolumesNegativeTest-1448645500-project May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: d0154612674d46c8ae3f75ff3aef4a00 May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-VolumesNegativeTest-1448645500-project May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 1a06833b-64cb-4d38-af44-a65846042bb0 could not be found. May 16 15:22:24.394094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '1a06833b-64cb-4d38-af44-a65846042bb0'} May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a06833b-64cb-4d38-af44-a65846042bb0 could not be found. May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:24.395500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a06833b-64cb-4d38-af44-a65846042bb0 could not be found. May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a06833b-64cb-4d38-af44-a65846042bb0 could not be found. May 16 15:22:24.397473 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:24.399554 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] Returning 404 to user: Instance 1a06833b-64cb-4d38-af44-a65846042bb0 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:24.399554 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4446f7fb-a610-42e0-a3bb-8b85bc737b8f tempest-VolumesNegativeTest-1448645500 tempest-VolumesNegativeTest-1448645500-project] 10.222.0.71 "GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0" status: 404 len: 111 microversion: 2.1 time: 0.030358 May 16 15:22:24.399554 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 382/764] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:24 2022] GET /compute/v2.1/servers/1a06833b-64cb-4d38-af44-a65846042bb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:25.167204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-184135813", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "networks": [{"uuid": "9d2175a1-ac19-4831-9c29-d30ae9fcfb01"}]}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:25.283676 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] validate_networks() for [('9d2175a1-ac19-4831-9c29-d30ae9fcfb01', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:22:25.755419 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:22:25.755877 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:22:25.756348 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:22:25.756754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:22:25.757159 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:22:25.767341 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.767818 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.768615 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.769061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.785930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Getting quotas for project 797cc8faa2204b1287cbcac0cd3d41f1. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:22:25.789993 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Getting quotas for user 724e8eceb4b44d29a0f535515a042e80 and project 797cc8faa2204b1287cbcac0cd3d41f1. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:22:25.800829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:22:25.803058 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:22:25.960815 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-fc6cd634-8794-4881-8c34-6644ea23ff34 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797864 May 16 15:22:25.962250 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 383/765] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:22:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:22:25.972564 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a90c29bb-3ac2-440e-9eae-fec24ae88e93 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:25.973392 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a90c29bb-3ac2-440e-9eae-fec24ae88e93 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:26.045154 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a90c29bb-3ac2-440e-9eae-fec24ae88e93 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:26.051882 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a90c29bb-3ac2-440e-9eae-fec24ae88e93 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1213 microversion: 2.1 time: 0.082842 May 16 15:22:26.052644 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 383/766] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:25 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:27.069694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8664d825-08c1-43f2-af1a-8e0e6324b0ad tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.070316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8664d825-08c1-43f2-af1a-8e0e6324b0ad tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.078708 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8664d825-08c1-43f2-af1a-8e0e6324b0ad tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.079436 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8664d825-08c1-43f2-af1a-8e0e6324b0ad tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.080698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8664d825-08c1-43f2-af1a-8e0e6324b0ad tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.081585 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8664d825-08c1-43f2-af1a-8e0e6324b0ad tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.162391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8664d825-08c1-43f2-af1a-8e0e6324b0ad tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:27.168565 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8664d825-08c1-43f2-af1a-8e0e6324b0ad tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1217 microversion: 2.1 time: 0.103172 May 16 15:22:27.169332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 384/767] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:27 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:28.186616 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-366c80a8-9dd4-4097-a5e4-27818e15de09 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:28.187230 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-366c80a8-9dd4-4097-a5e4-27818e15de09 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:28.194299 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-366c80a8-9dd4-4097-a5e4-27818e15de09 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.194786 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-366c80a8-9dd4-4097-a5e4-27818e15de09 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.195575 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-366c80a8-9dd4-4097-a5e4-27818e15de09 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.196034 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-366c80a8-9dd4-4097-a5e4-27818e15de09 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.259869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-366c80a8-9dd4-4097-a5e4-27818e15de09 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:28.267880 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-366c80a8-9dd4-4097-a5e4-27818e15de09 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1265 microversion: 2.1 time: 0.085284 May 16 15:22:28.268452 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 384/768] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:28 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:29.285173 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-058a56a9-64e3-4782-8e98-5f88b9f6c44f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:29.285814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-058a56a9-64e3-4782-8e98-5f88b9f6c44f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:29.293235 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-058a56a9-64e3-4782-8e98-5f88b9f6c44f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.293684 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-058a56a9-64e3-4782-8e98-5f88b9f6c44f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.294467 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-058a56a9-64e3-4782-8e98-5f88b9f6c44f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.294908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-058a56a9-64e3-4782-8e98-5f88b9f6c44f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.500971 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-058a56a9-64e3-4782-8e98-5f88b9f6c44f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:29.509397 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-058a56a9-64e3-4782-8e98-5f88b9f6c44f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.228216 May 16 15:22:29.510067 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 385/769] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:29 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:30.146374 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-1c63e7eb-2dbf-4f8f-84f6-2237a8226415 req-9bac9a01-26f2-4f88-941d-dd26311e5549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c5da07-c654-4955-b69c-8a8ad9de6853", "tag": "d05f22fb-61c4-4547-a3de-62b5dbfbd546"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:30.156570 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1c63e7eb-2dbf-4f8f-84f6-2237a8226415 req-9bac9a01-26f2-4f88-941d-dd26311e5549 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.157010 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1c63e7eb-2dbf-4f8f-84f6-2237a8226415 req-9bac9a01-26f2-4f88-941d-dd26311e5549 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.172330 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-1c63e7eb-2dbf-4f8f-84f6-2237a8226415 req-9bac9a01-26f2-4f88-941d-dd26311e5549 service nova] Creating event network-changed:d05f22fb-61c4-4547-a3de-62b5dbfbd546 for instance 40c5da07-c654-4955-b69c-8a8ad9de6853 on hv-cinder-84175 May 16 15:22:30.174582 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-1c63e7eb-2dbf-4f8f-84f6-2237a8226415 req-9bac9a01-26f2-4f88-941d-dd26311e5549 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031770 May 16 15:22:30.175207 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 385/770] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:30.527078 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-23be8823-c4ef-4fb1-9862-8faf27a4f946 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:30.528515 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-23be8823-c4ef-4fb1-9862-8faf27a4f946 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:30.534739 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-23be8823-c4ef-4fb1-9862-8faf27a4f946 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.535202 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-23be8823-c4ef-4fb1-9862-8faf27a4f946 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.536021 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-23be8823-c4ef-4fb1-9862-8faf27a4f946 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.536465 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-23be8823-c4ef-4fb1-9862-8faf27a4f946 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.751123 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-23be8823-c4ef-4fb1-9862-8faf27a4f946 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:30.758704 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-23be8823-c4ef-4fb1-9862-8faf27a4f946 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.236053 May 16 15:22:30.759292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 386/771] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:30 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:31.777139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-67f22a51-f7bf-41ff-80df-4bc6846ff7a8 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:31.777829 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-67f22a51-f7bf-41ff-80df-4bc6846ff7a8 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:31.784022 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-67f22a51-f7bf-41ff-80df-4bc6846ff7a8 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.789678 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-67f22a51-f7bf-41ff-80df-4bc6846ff7a8 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.789678 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-67f22a51-f7bf-41ff-80df-4bc6846ff7a8 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.789678 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-67f22a51-f7bf-41ff-80df-4bc6846ff7a8 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.923279 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-67f22a51-f7bf-41ff-80df-4bc6846ff7a8 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:31.931273 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-67f22a51-f7bf-41ff-80df-4bc6846ff7a8 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.158880 May 16 15:22:31.931966 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 386/772] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:31 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:32.948539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5d5ff6b9-3c45-411d-8bd1-d0f3393bc852 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:32.949156 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5d5ff6b9-3c45-411d-8bd1-d0f3393bc852 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:32.955730 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5d5ff6b9-3c45-411d-8bd1-d0f3393bc852 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.956130 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5d5ff6b9-3c45-411d-8bd1-d0f3393bc852 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:32.956888 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5d5ff6b9-3c45-411d-8bd1-d0f3393bc852 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.957320 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5d5ff6b9-3c45-411d-8bd1-d0f3393bc852 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:33.083301 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5d5ff6b9-3c45-411d-8bd1-d0f3393bc852 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:33.090570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5d5ff6b9-3c45-411d-8bd1-d0f3393bc852 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.146765 May 16 15:22:33.091838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 387/773] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:32 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:34.103904 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-68b5d508-5c3e-4148-9e18-6a3ee8cfb1f3 req-91c1160c-8930-4871-88a8-08cb344deee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c5da07-c654-4955-b69c-8a8ad9de6853", "name": "network-vif-plugged", "status": "completed", "tag": "d05f22fb-61c4-4547-a3de-62b5dbfbd546"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:34.107748 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d1470ff8-1874-465d-9990-7f7737616afa tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:34.108688 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d1470ff8-1874-465d-9990-7f7737616afa tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:34.114832 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-68b5d508-5c3e-4148-9e18-6a3ee8cfb1f3 req-91c1160c-8930-4871-88a8-08cb344deee2 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:34.115452 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d1470ff8-1874-465d-9990-7f7737616afa tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:34.115818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-68b5d508-5c3e-4148-9e18-6a3ee8cfb1f3 req-91c1160c-8930-4871-88a8-08cb344deee2 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:34.115955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d1470ff8-1874-465d-9990-7f7737616afa tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:34.116722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d1470ff8-1874-465d-9990-7f7737616afa tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:34.117166 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d1470ff8-1874-465d-9990-7f7737616afa tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:34.131311 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-68b5d508-5c3e-4148-9e18-6a3ee8cfb1f3 req-91c1160c-8930-4871-88a8-08cb344deee2 service nova] Creating event network-vif-plugged:d05f22fb-61c4-4547-a3de-62b5dbfbd546 for instance 40c5da07-c654-4955-b69c-8a8ad9de6853 on hv-cinder-84175 May 16 15:22:34.138377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-68b5d508-5c3e-4148-9e18-6a3ee8cfb1f3 req-91c1160c-8930-4871-88a8-08cb344deee2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039082 May 16 15:22:34.138982 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 387/774] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:34.257464 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d1470ff8-1874-465d-9990-7f7737616afa tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:34.265976 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d1470ff8-1874-465d-9990-7f7737616afa tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.162350 May 16 15:22:34.266539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 388/775] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:34 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:35.284381 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a07d4b54-97bd-4a8d-bb93-bf93c3993302 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:35.285074 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a07d4b54-97bd-4a8d-bb93-bf93c3993302 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:35.291922 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a07d4b54-97bd-4a8d-bb93-bf93c3993302 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:35.292367 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a07d4b54-97bd-4a8d-bb93-bf93c3993302 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:35.293119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a07d4b54-97bd-4a8d-bb93-bf93c3993302 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:35.293549 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a07d4b54-97bd-4a8d-bb93-bf93c3993302 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:35.427481 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a07d4b54-97bd-4a8d-bb93-bf93c3993302 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:35.435175 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a07d4b54-97bd-4a8d-bb93-bf93c3993302 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.155360 May 16 15:22:35.435769 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 388/776] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:35 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:36.451988 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d7f7a5b9-f24f-44b6-9f3c-aa30957d1240 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:36.452761 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d7f7a5b9-f24f-44b6-9f3c-aa30957d1240 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:36.459100 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d7f7a5b9-f24f-44b6-9f3c-aa30957d1240 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.459549 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d7f7a5b9-f24f-44b6-9f3c-aa30957d1240 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.460351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d7f7a5b9-f24f-44b6-9f3c-aa30957d1240 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.460787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d7f7a5b9-f24f-44b6-9f3c-aa30957d1240 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.585775 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d7f7a5b9-f24f-44b6-9f3c-aa30957d1240 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:36.594734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d7f7a5b9-f24f-44b6-9f3c-aa30957d1240 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.146479 May 16 15:22:36.595322 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 389/777] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:36 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:37.611882 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-fc030601-ac2a-49d0-8f05-6c18fe6e97b3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:37.612503 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-fc030601-ac2a-49d0-8f05-6c18fe6e97b3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:37.619849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc030601-ac2a-49d0-8f05-6c18fe6e97b3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:37.620305 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc030601-ac2a-49d0-8f05-6c18fe6e97b3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:37.621092 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc030601-ac2a-49d0-8f05-6c18fe6e97b3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:37.621531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fc030601-ac2a-49d0-8f05-6c18fe6e97b3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:37.752684 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-fc030601-ac2a-49d0-8f05-6c18fe6e97b3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:37.760208 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-fc030601-ac2a-49d0-8f05-6c18fe6e97b3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.152241 May 16 15:22:37.760767 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 389/778] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:37 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:38.777340 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-86550c47-f857-4780-b28a-354441ad5bb1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:38.777911 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-86550c47-f857-4780-b28a-354441ad5bb1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:38.784187 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86550c47-f857-4780-b28a-354441ad5bb1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:38.784637 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86550c47-f857-4780-b28a-354441ad5bb1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:38.785396 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86550c47-f857-4780-b28a-354441ad5bb1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:38.785832 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-86550c47-f857-4780-b28a-354441ad5bb1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:38.909056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-86550c47-f857-4780-b28a-354441ad5bb1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:38.916514 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-86550c47-f857-4780-b28a-354441ad5bb1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.143919 May 16 15:22:38.917074 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 390/779] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:38 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:39.933800 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d5d9d027-ca09-4dbe-b4a0-42ee222499b1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:39.934405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d5d9d027-ca09-4dbe-b4a0-42ee222499b1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:39.940761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5d9d027-ca09-4dbe-b4a0-42ee222499b1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:39.941207 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5d9d027-ca09-4dbe-b4a0-42ee222499b1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:39.941961 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5d9d027-ca09-4dbe-b4a0-42ee222499b1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:39.942393 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d5d9d027-ca09-4dbe-b4a0-42ee222499b1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:40.073051 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d5d9d027-ca09-4dbe-b4a0-42ee222499b1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:40.080160 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d5d9d027-ca09-4dbe-b4a0-42ee222499b1 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.150873 May 16 15:22:40.080720 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 390/780] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:39 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:41.096321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-db3190ae-b839-4a52-afbd-e924a56de55a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:41.096966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-db3190ae-b839-4a52-afbd-e924a56de55a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:41.103551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-db3190ae-b839-4a52-afbd-e924a56de55a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:41.104044 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-db3190ae-b839-4a52-afbd-e924a56de55a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:41.104815 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-db3190ae-b839-4a52-afbd-e924a56de55a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:41.105252 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-db3190ae-b839-4a52-afbd-e924a56de55a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:41.230068 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-db3190ae-b839-4a52-afbd-e924a56de55a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:41.237257 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-db3190ae-b839-4a52-afbd-e924a56de55a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.144793 May 16 15:22:41.237823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 391/781] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:41 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:42.254607 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7f56f67e-59a2-4469-9b62-1b88571e394f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:42.255256 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7f56f67e-59a2-4469-9b62-1b88571e394f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:42.262057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f56f67e-59a2-4469-9b62-1b88571e394f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:42.262506 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f56f67e-59a2-4469-9b62-1b88571e394f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:42.263270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f56f67e-59a2-4469-9b62-1b88571e394f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:42.263745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f56f67e-59a2-4469-9b62-1b88571e394f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:42.392045 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7f56f67e-59a2-4469-9b62-1b88571e394f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:42.400506 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7f56f67e-59a2-4469-9b62-1b88571e394f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1313 microversion: 2.1 time: 0.148718 May 16 15:22:42.401106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 391/782] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:42 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:43.416945 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-ea3543d8-fc33-419b-99ec-cae46182c8c9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:43.417571 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-ea3543d8-fc33-419b-99ec-cae46182c8c9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:43.424180 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea3543d8-fc33-419b-99ec-cae46182c8c9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:43.424754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea3543d8-fc33-419b-99ec-cae46182c8c9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:43.425537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea3543d8-fc33-419b-99ec-cae46182c8c9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:43.425978 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-ea3543d8-fc33-419b-99ec-cae46182c8c9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:43.564071 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-ea3543d8-fc33-419b-99ec-cae46182c8c9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:43.572363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-ea3543d8-fc33-419b-99ec-cae46182c8c9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1497 microversion: 2.1 time: 0.159094 May 16 15:22:43.572934 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 392/783] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:43 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:44.762540 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-399250ef-d9af-453d-8aaf-42ba57af6c46 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:44.763072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-399250ef-d9af-453d-8aaf-42ba57af6c46 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:44.769337 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-399250ef-d9af-453d-8aaf-42ba57af6c46 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:44.769786 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-399250ef-d9af-453d-8aaf-42ba57af6c46 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:44.770548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-399250ef-d9af-453d-8aaf-42ba57af6c46 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:44.770982 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-399250ef-d9af-453d-8aaf-42ba57af6c46 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:44.796813 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-399250ef-d9af-453d-8aaf-42ba57af6c46 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:22:45.101023 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-399250ef-d9af-453d-8aaf-42ba57af6c46 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "DELETE /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 204 len: 0 microversion: 2.1 time: 0.342991 May 16 15:22:45.101870 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 392/784] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:22:44 2022] DELETE /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:22:45.110117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8d283d2b-207c-45c9-9e4d-be9179c50c0f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:45.110764 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8d283d2b-207c-45c9-9e4d-be9179c50c0f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:45.116869 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8d283d2b-207c-45c9-9e4d-be9179c50c0f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:45.117325 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8d283d2b-207c-45c9-9e4d-be9179c50c0f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:45.118598 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8d283d2b-207c-45c9-9e4d-be9179c50c0f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:45.119035 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8d283d2b-207c-45c9-9e4d-be9179c50c0f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:45.250469 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8d283d2b-207c-45c9-9e4d-be9179c50c0f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:45.257792 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8d283d2b-207c-45c9-9e4d-be9179c50c0f tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1503 microversion: 2.1 time: 0.151459 May 16 15:22:45.263125 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 393/785] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:45 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:46.276504 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-04c64d3b-e9dc-4560-95d3-0ed912f69869 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:46.277210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-04c64d3b-e9dc-4560-95d3-0ed912f69869 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:46.283705 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-04c64d3b-e9dc-4560-95d3-0ed912f69869 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:46.284159 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-04c64d3b-e9dc-4560-95d3-0ed912f69869 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:46.284943 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-04c64d3b-e9dc-4560-95d3-0ed912f69869 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:46.303336 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-04c64d3b-e9dc-4560-95d3-0ed912f69869 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:46.421748 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-04c64d3b-e9dc-4560-95d3-0ed912f69869 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:46.429183 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-04c64d3b-e9dc-4560-95d3-0ed912f69869 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1503 microversion: 2.1 time: 0.157993 May 16 15:22:46.429761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 393/786] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:46 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:47.154153 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-3405293b-3aaa-42e7-acb9-084bcb0d3532 req-51ec7746-2f1c-4f6f-bfce-0f315d4a1a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c5da07-c654-4955-b69c-8a8ad9de6853", "name": "network-vif-deleted", "tag": "d05f22fb-61c4-4547-a3de-62b5dbfbd546"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:47.162390 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-3405293b-3aaa-42e7-acb9-084bcb0d3532 req-51ec7746-2f1c-4f6f-bfce-0f315d4a1a67 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:47.162836 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-3405293b-3aaa-42e7-acb9-084bcb0d3532 req-51ec7746-2f1c-4f6f-bfce-0f315d4a1a67 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:47.178080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-3405293b-3aaa-42e7-acb9-084bcb0d3532 req-51ec7746-2f1c-4f6f-bfce-0f315d4a1a67 service nova] Creating event network-vif-deleted:d05f22fb-61c4-4547-a3de-62b5dbfbd546 for instance 40c5da07-c654-4955-b69c-8a8ad9de6853 on hv-cinder-84175 May 16 15:22:47.184810 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-3405293b-3aaa-42e7-acb9-084bcb0d3532 req-51ec7746-2f1c-4f6f-bfce-0f315d4a1a67 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034460 May 16 15:22:47.185426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 394/787] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:47.446426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:47.447072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:47.453880 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:47.454323 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:47.455528 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:47.455999 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:47.497267 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:47.497723 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:47.498182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lazy-loading 'fault' on Instance uuid 40c5da07-c654-4955-b69c-8a8ad9de6853 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:47.549372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:47.549372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-89e85774-6197-461c-8c93-0bd4ff8cb6c3 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1303 microversion: 2.1 time: 0.106534 May 16 15:22:47.551786 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 394/788] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:47 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:48.567075 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:48.567814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:48.575784 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:48.576374 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:48.577007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:48.577442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:48.609334 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:48.609790 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:48.610239 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lazy-loading 'fault' on Instance uuid 40c5da07-c654-4955-b69c-8a8ad9de6853 {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:48.651740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:48.658910 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5122c440-b99c-4ffe-b94d-3f5344670786 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 200 len: 1303 microversion: 2.1 time: 0.095957 May 16 15:22:48.659475 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 395/789] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:48 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:49.676670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:49.677289 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 40c5da07-c654-4955-b69c-8a8ad9de6853] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:49.683710 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:49.684220 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:49.684993 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:49.685435 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:49.698792 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] HTTP exception thrown: Instance 40c5da07-c654-4955-b69c-8a8ad9de6853 could not be found. May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Request method failure captured: May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 HTTP/1.1 May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmwu-mcOZ38sZJhbT0yt3p2HE26xmwRKkSd_m_rDgviLaZg11_6U9Eay5xbIbd5mtelXNmnaXQxjE7wPqm3bdlMf0BoP5SY36tjfCppnKOk7HKFtBdTDhdPj3lw44XAssBazyHSMymLy9B0t5eoaThLHRZ8cPYCJfI5FRCuVelH_hAw May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 797cc8faa2204b1287cbcac0cd3d41f1 May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-VolumesActionsTest-1342571657 May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:22:49.700432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/797cc8faa2204b1287cbcac0cd3d41f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/797cc8faa2204b1287cbcac0cd3d41f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_797cc8faa2204b1287cbcac0cd3d41f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/797cc8faa2204b1287cbcac0cd3d41f1"}]}] May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-VolumesActionsTest-1342571657 May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 797cc8faa2204b1287cbcac0cd3d41f1 May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-VolumesActionsTest-1342571657 May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-VolumesActionsTest-1342571657-project May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 724e8eceb4b44d29a0f535515a042e80 May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-VolumesActionsTest-1342571657-project May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 40c5da07-c654-4955-b69c-8a8ad9de6853 could not be found. May 16 15:22:49.702104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': '40c5da07-c654-4955-b69c-8a8ad9de6853'} May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c5da07-c654-4955-b69c-8a8ad9de6853 could not be found. May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:49.702934 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c5da07-c654-4955-b69c-8a8ad9de6853 could not be found. May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c5da07-c654-4955-b69c-8a8ad9de6853 could not be found. May 16 15:22:49.704280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:22:49.705398 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Returning 404 to user: Instance 40c5da07-c654-4955-b69c-8a8ad9de6853 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:49.705398 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e23119ee-0576-4acc-9fbf-7d55f5d555be tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853" status: 404 len: 111 microversion: 2.1 time: 0.028978 May 16 15:22:49.705398 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 395/790] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:49 2022] GET /compute/v2.1/servers/40c5da07-c654-4955-b69c-8a8ad9de6853 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:49.803306 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1879396879", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "networks": [{"uuid": "9d2175a1-ac19-4831-9c29-d30ae9fcfb01"}]}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:49.858593 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] validate_networks() for [('9d2175a1-ac19-4831-9c29-d30ae9fcfb01', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:22:50.515969 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:22:50.516399 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:22:50.516960 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:22:50.517534 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:22:50.518036 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:22:50.527123 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:50.527578 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:50.528416 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:50.528909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:50.545903 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Getting quotas for project 797cc8faa2204b1287cbcac0cd3d41f1. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:22:50.549897 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Getting quotas for user 724e8eceb4b44d29a0f535515a042e80 and project 797cc8faa2204b1287cbcac0cd3d41f1. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:22:50.561651 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:22:50.563943 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:22:50.704800 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b7c6c5d9-2d0f-4ff8-a0e1-ffd171251c2b tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905326 May 16 15:22:50.705445 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 396/791] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:22:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:22:50.715519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-99ed31eb-6965-4804-8a80-5be78a2d8924 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:50.716180 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-99ed31eb-6965-4804-8a80-5be78a2d8924 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:50.771989 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-99ed31eb-6965-4804-8a80-5be78a2d8924 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:50.779416 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-99ed31eb-6965-4804-8a80-5be78a2d8924 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1214 microversion: 2.1 time: 0.067830 May 16 15:22:50.780125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 396/792] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:50 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:51.797928 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-9e9c077b-1a57-478b-81fc-574ab804cc3e tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:51.798561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-9e9c077b-1a57-478b-81fc-574ab804cc3e tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:51.805353 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9e9c077b-1a57-478b-81fc-574ab804cc3e tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:51.805800 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9e9c077b-1a57-478b-81fc-574ab804cc3e tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:51.807177 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9e9c077b-1a57-478b-81fc-574ab804cc3e tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:51.807617 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9e9c077b-1a57-478b-81fc-574ab804cc3e tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:51.870636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-9e9c077b-1a57-478b-81fc-574ab804cc3e tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:51.878374 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-9e9c077b-1a57-478b-81fc-574ab804cc3e tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1218 microversion: 2.1 time: 0.085085 May 16 15:22:51.878951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 397/793] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:51 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:52.896205 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8e0ed20b-dc09-4611-94e2-b8b63d546167 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:52.897096 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8e0ed20b-dc09-4611-94e2-b8b63d546167 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:52.905065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8e0ed20b-dc09-4611-94e2-b8b63d546167 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:52.905509 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8e0ed20b-dc09-4611-94e2-b8b63d546167 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:52.906275 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8e0ed20b-dc09-4611-94e2-b8b63d546167 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:52.906704 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8e0ed20b-dc09-4611-94e2-b8b63d546167 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:52.984730 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-8e0ed20b-dc09-4611-94e2-b8b63d546167 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:52.995296 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8e0ed20b-dc09-4611-94e2-b8b63d546167 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1274 microversion: 2.1 time: 0.102058 May 16 15:22:52.996944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 397/794] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:52 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:54.014032 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-9cafec57-3055-4ce2-ba8a-a3b69b9028f9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:54.014950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-9cafec57-3055-4ce2-ba8a-a3b69b9028f9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:54.021236 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9cafec57-3055-4ce2-ba8a-a3b69b9028f9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:54.022130 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9cafec57-3055-4ce2-ba8a-a3b69b9028f9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:54.022957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9cafec57-3055-4ce2-ba8a-a3b69b9028f9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:54.023394 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9cafec57-3055-4ce2-ba8a-a3b69b9028f9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:54.170329 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-9cafec57-3055-4ce2-ba8a-a3b69b9028f9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:54.177469 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-9cafec57-3055-4ce2-ba8a-a3b69b9028f9 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1314 microversion: 2.1 time: 0.167864 May 16 15:22:54.178022 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 398/795] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:54 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:54.505044 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-0569308c-45d6-4f7a-81b2-1912d5913128 req-6a29106b-1daf-4f3c-a34d-64a451e2e2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "043723c2-9196-4474-9858-b0c2c95a7230", "tag": "ffb1ba86-285b-406e-89c1-97b47a9e839e"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:54.514672 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-0569308c-45d6-4f7a-81b2-1912d5913128 req-6a29106b-1daf-4f3c-a34d-64a451e2e2c8 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:54.518128 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-0569308c-45d6-4f7a-81b2-1912d5913128 req-6a29106b-1daf-4f3c-a34d-64a451e2e2c8 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:54.526624 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-0569308c-45d6-4f7a-81b2-1912d5913128 req-6a29106b-1daf-4f3c-a34d-64a451e2e2c8 service nova] Creating event network-changed:ffb1ba86-285b-406e-89c1-97b47a9e839e for instance 043723c2-9196-4474-9858-b0c2c95a7230 on hv-cinder-84175 May 16 15:22:54.531389 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-0569308c-45d6-4f7a-81b2-1912d5913128 req-6a29106b-1daf-4f3c-a34d-64a451e2e2c8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030081 May 16 15:22:54.532022 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 398/796] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:55.194356 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-616dc6e0-6162-4dc2-8538-57461e8b0366 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:55.194896 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-616dc6e0-6162-4dc2-8538-57461e8b0366 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:55.201381 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-616dc6e0-6162-4dc2-8538-57461e8b0366 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:55.201894 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-616dc6e0-6162-4dc2-8538-57461e8b0366 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:55.202657 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-616dc6e0-6162-4dc2-8538-57461e8b0366 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:55.203095 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-616dc6e0-6162-4dc2-8538-57461e8b0366 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:55.334168 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-616dc6e0-6162-4dc2-8538-57461e8b0366 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:55.342104 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-616dc6e0-6162-4dc2-8538-57461e8b0366 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1314 microversion: 2.1 time: 0.151676 May 16 15:22:55.342673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 399/797] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:55 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:56.360138 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ba9269b7-0dec-480d-83ce-25e60cf71873 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:56.360839 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ba9269b7-0dec-480d-83ce-25e60cf71873 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:56.366794 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ba9269b7-0dec-480d-83ce-25e60cf71873 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:56.367238 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ba9269b7-0dec-480d-83ce-25e60cf71873 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:56.368026 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ba9269b7-0dec-480d-83ce-25e60cf71873 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:56.368455 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ba9269b7-0dec-480d-83ce-25e60cf71873 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:56.545745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ba9269b7-0dec-480d-83ce-25e60cf71873 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:56.552982 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ba9269b7-0dec-480d-83ce-25e60cf71873 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1314 microversion: 2.1 time: 0.198483 May 16 15:22:56.553554 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 399/798] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:56 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:57.568616 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-69a38b3a-42b5-4a99-aa00-8a811b61c04a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:57.569233 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-69a38b3a-42b5-4a99-aa00-8a811b61c04a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:57.575799 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-69a38b3a-42b5-4a99-aa00-8a811b61c04a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:57.576247 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-69a38b3a-42b5-4a99-aa00-8a811b61c04a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:57.577007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-69a38b3a-42b5-4a99-aa00-8a811b61c04a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:57.577441 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-69a38b3a-42b5-4a99-aa00-8a811b61c04a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:57.712906 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-69a38b3a-42b5-4a99-aa00-8a811b61c04a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:57.720850 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-69a38b3a-42b5-4a99-aa00-8a811b61c04a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1314 microversion: 2.1 time: 0.156100 May 16 15:22:57.721415 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 400/799] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:57 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:58.738350 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b04b5fbf-6900-4bfa-9a5e-bfeef9e6263d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:58.739672 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b04b5fbf-6900-4bfa-9a5e-bfeef9e6263d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:58.747348 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b04b5fbf-6900-4bfa-9a5e-bfeef9e6263d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:58.747836 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b04b5fbf-6900-4bfa-9a5e-bfeef9e6263d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:58.748625 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b04b5fbf-6900-4bfa-9a5e-bfeef9e6263d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:58.749066 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b04b5fbf-6900-4bfa-9a5e-bfeef9e6263d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:58.883256 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b04b5fbf-6900-4bfa-9a5e-bfeef9e6263d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:58.890709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b04b5fbf-6900-4bfa-9a5e-bfeef9e6263d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1314 microversion: 2.1 time: 0.156188 May 16 15:22:58.891287 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 400/800] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:58 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:59.907812 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6fb3c611-951a-4a36-8c0f-d9284c8adc9d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:59.908391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6fb3c611-951a-4a36-8c0f-d9284c8adc9d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:59.914594 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6fb3c611-951a-4a36-8c0f-d9284c8adc9d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:59.915045 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6fb3c611-951a-4a36-8c0f-d9284c8adc9d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:59.915847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6fb3c611-951a-4a36-8c0f-d9284c8adc9d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:59.916277 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6fb3c611-951a-4a36-8c0f-d9284c8adc9d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:00.049134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6fb3c611-951a-4a36-8c0f-d9284c8adc9d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:00.057094 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6fb3c611-951a-4a36-8c0f-d9284c8adc9d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1314 microversion: 2.1 time: 0.153102 May 16 15:23:00.061309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 401/801] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:22:59 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:00.728604 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-4fded585-13b0-4715-97d5-3dfb3c1b4c89 req-ea198969-462e-4dd5-8e23-d07127361178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "043723c2-9196-4474-9858-b0c2c95a7230", "name": "network-vif-plugged", "status": "completed", "tag": "ffb1ba86-285b-406e-89c1-97b47a9e839e"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:00.746664 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-4fded585-13b0-4715-97d5-3dfb3c1b4c89 req-ea198969-462e-4dd5-8e23-d07127361178 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:00.746664 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-4fded585-13b0-4715-97d5-3dfb3c1b4c89 req-ea198969-462e-4dd5-8e23-d07127361178 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:00.756676 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-4fded585-13b0-4715-97d5-3dfb3c1b4c89 req-ea198969-462e-4dd5-8e23-d07127361178 service nova] Creating event network-vif-plugged:ffb1ba86-285b-406e-89c1-97b47a9e839e for instance 043723c2-9196-4474-9858-b0c2c95a7230 on hv-cinder-84175 May 16 15:23:00.761567 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-4fded585-13b0-4715-97d5-3dfb3c1b4c89 req-ea198969-462e-4dd5-8e23-d07127361178 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036460 May 16 15:23:00.762289 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 401/802] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:01.078416 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7b3de3ac-d0da-41f7-ab05-eec41f749e12 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:01.079311 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7b3de3ac-d0da-41f7-ab05-eec41f749e12 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:01.085405 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b3de3ac-d0da-41f7-ab05-eec41f749e12 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:01.087351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b3de3ac-d0da-41f7-ab05-eec41f749e12 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:01.087351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b3de3ac-d0da-41f7-ab05-eec41f749e12 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:01.087351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7b3de3ac-d0da-41f7-ab05-eec41f749e12 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:01.261126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7b3de3ac-d0da-41f7-ab05-eec41f749e12 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:01.269563 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7b3de3ac-d0da-41f7-ab05-eec41f749e12 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1314 microversion: 2.1 time: 0.196622 May 16 15:23:01.270136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 402/803] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:01 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:02.287502 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ecfdb775-884c-498e-859b-0aac57f57d64 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:02.288242 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ecfdb775-884c-498e-859b-0aac57f57d64 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:02.302178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ecfdb775-884c-498e-859b-0aac57f57d64 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:02.302178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ecfdb775-884c-498e-859b-0aac57f57d64 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:02.302178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ecfdb775-884c-498e-859b-0aac57f57d64 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:02.302178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ecfdb775-884c-498e-859b-0aac57f57d64 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:02.444104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ecfdb775-884c-498e-859b-0aac57f57d64 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:02.452215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ecfdb775-884c-498e-859b-0aac57f57d64 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1314 microversion: 2.1 time: 0.169259 May 16 15:23:02.452981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 402/804] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:02 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:03.472266 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-74490d25-ccd8-406d-9d90-7bffba53b28d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:03.472266 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-74490d25-ccd8-406d-9d90-7bffba53b28d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:03.478930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-74490d25-ccd8-406d-9d90-7bffba53b28d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:03.479395 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-74490d25-ccd8-406d-9d90-7bffba53b28d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:03.480183 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-74490d25-ccd8-406d-9d90-7bffba53b28d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:03.480613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-74490d25-ccd8-406d-9d90-7bffba53b28d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:03.623934 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-74490d25-ccd8-406d-9d90-7bffba53b28d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:03.631187 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-74490d25-ccd8-406d-9d90-7bffba53b28d tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1498 microversion: 2.1 time: 0.165953 May 16 15:23:03.631772 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 403/805] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:03 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:04.661291 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2ebf3d85-a562-4d58-a789-ee3899740a79 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:04.661795 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2ebf3d85-a562-4d58-a789-ee3899740a79 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:04.668072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2ebf3d85-a562-4d58-a789-ee3899740a79 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:04.668517 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2ebf3d85-a562-4d58-a789-ee3899740a79 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:04.669383 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2ebf3d85-a562-4d58-a789-ee3899740a79 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:04.669821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2ebf3d85-a562-4d58-a789-ee3899740a79 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:04.695337 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2ebf3d85-a562-4d58-a789-ee3899740a79 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:23:05.009324 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2ebf3d85-a562-4d58-a789-ee3899740a79 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "DELETE /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 204 len: 0 microversion: 2.1 time: 0.351539 May 16 15:23:05.009909 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 403/806] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:23:04 2022] DELETE /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:23:05.018524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-34c7a3ad-79bf-4415-95b3-a912b9119af2 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:05.019143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-34c7a3ad-79bf-4415-95b3-a912b9119af2 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:05.025771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-34c7a3ad-79bf-4415-95b3-a912b9119af2 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:05.026217 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-34c7a3ad-79bf-4415-95b3-a912b9119af2 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:05.026976 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-34c7a3ad-79bf-4415-95b3-a912b9119af2 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:05.027404 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-34c7a3ad-79bf-4415-95b3-a912b9119af2 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:05.159278 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-34c7a3ad-79bf-4415-95b3-a912b9119af2 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:05.166734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-34c7a3ad-79bf-4415-95b3-a912b9119af2 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1504 microversion: 2.1 time: 0.151940 May 16 15:23:05.167307 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 404/807] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:05 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:06.198658 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-dd383aea-9b40-4792-8374-fd028e488e54 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:06.199435 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-dd383aea-9b40-4792-8374-fd028e488e54 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:06.205818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dd383aea-9b40-4792-8374-fd028e488e54 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:06.206266 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dd383aea-9b40-4792-8374-fd028e488e54 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:06.207035 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dd383aea-9b40-4792-8374-fd028e488e54 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:06.207470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-dd383aea-9b40-4792-8374-fd028e488e54 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:06.341815 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-dd383aea-9b40-4792-8374-fd028e488e54 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:06.349845 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-dd383aea-9b40-4792-8374-fd028e488e54 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1504 microversion: 2.1 time: 0.155286 May 16 15:23:06.350406 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 404/808] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:06 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:07.023603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-b982ec55-6764-4b33-be14-463d13d63af3 req-a9cd70d9-6a7a-4c85-b209-f7a682e7e645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "043723c2-9196-4474-9858-b0c2c95a7230", "name": "network-vif-deleted", "tag": "ffb1ba86-285b-406e-89c1-97b47a9e839e"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:07.032992 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-b982ec55-6764-4b33-be14-463d13d63af3 req-a9cd70d9-6a7a-4c85-b209-f7a682e7e645 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:07.033434 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-b982ec55-6764-4b33-be14-463d13d63af3 req-a9cd70d9-6a7a-4c85-b209-f7a682e7e645 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:07.044039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-b982ec55-6764-4b33-be14-463d13d63af3 req-a9cd70d9-6a7a-4c85-b209-f7a682e7e645 service nova] Creating event network-vif-deleted:ffb1ba86-285b-406e-89c1-97b47a9e839e for instance 043723c2-9196-4474-9858-b0c2c95a7230 on hv-cinder-84175 May 16 15:23:07.049287 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-b982ec55-6764-4b33-be14-463d13d63af3 req-a9cd70d9-6a7a-4c85-b209-f7a682e7e645 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029690 May 16 15:23:07.049851 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 405/809] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:07.367543 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:07.368203 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:07.375003 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:07.375476 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:07.380668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:07.380668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:07.409264 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:07.409264 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:07.409264 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lazy-loading 'fault' on Instance uuid 043723c2-9196-4474-9858-b0c2c95a7230 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:23:07.451927 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e8eceb4b44d29a0f535515a042e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797cc8faa2204b1287cbcac0cd3d41f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:07.458944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-641d53dc-0c3a-4c1a-9b31-713cee1eaa5a tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 200 len: 1304 microversion: 2.1 time: 0.095136 May 16 15:23:07.459518 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 405/810] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:07 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:08.478829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:08.479544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] [instance: 043723c2-9196-4474-9858-b0c2c95a7230] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:08.485702 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:08.489055 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:08.489055 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:08.489055 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:08.501838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] HTTP exception thrown: Instance 043723c2-9196-4474-9858-b0c2c95a7230 could not be found. May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Request method failure captured: May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 HTTP/1.1 May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmwu-mcOZ38sZJhbT0yt3p2HE26xmwRKkSd_m_rDgviLaZg11_6U9Eay5xbIbd5mtelXNmnaXQxjE7wPqm3bdlMf0BoP5SY36tjfCppnKOk7HKFtBdTDhdPj3lw44XAssBazyHSMymLy9B0t5eoaThLHRZ8cPYCJfI5FRCuVelH_hAw May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 797cc8faa2204b1287cbcac0cd3d41f1 May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesActionsTest-1342571657 May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:23:08.503442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/797cc8faa2204b1287cbcac0cd3d41f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/797cc8faa2204b1287cbcac0cd3d41f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_797cc8faa2204b1287cbcac0cd3d41f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/797cc8faa2204b1287cbcac0cd3d41f1"}]}] May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesActionsTest-1342571657 May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 797cc8faa2204b1287cbcac0cd3d41f1 May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesActionsTest-1342571657 May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesActionsTest-1342571657-project May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 724e8eceb4b44d29a0f535515a042e80 May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesActionsTest-1342571657-project May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 043723c2-9196-4474-9858-b0c2c95a7230 could not be found. May 16 15:23:08.505138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '043723c2-9196-4474-9858-b0c2c95a7230'} May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 043723c2-9196-4474-9858-b0c2c95a7230 could not be found. May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:23:08.506040 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 043723c2-9196-4474-9858-b0c2c95a7230 could not be found. May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 043723c2-9196-4474-9858-b0c2c95a7230 could not be found. May 16 15:23:08.507562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:23:08.508935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] Returning 404 to user: Instance 043723c2-9196-4474-9858-b0c2c95a7230 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:23:08.508935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-fc22da22-5b5d-4241-839c-98d661b245b5 tempest-VolumesActionsTest-1342571657 tempest-VolumesActionsTest-1342571657-project] 10.222.0.71 "GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230" status: 404 len: 111 microversion: 2.1 time: 0.030735 May 16 15:23:08.508935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 406/811] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:08 2022] GET /compute/v2.1/servers/043723c2-9196-4474-9858-b0c2c95a7230 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:23:16.780289 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2084266221", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "networks": [{"uuid": "2aa68265-e33f-4bb0-af32-8089310ebac3"}]}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:16.854663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] validate_networks() for [('2aa68265-e33f-4bb0-af32-8089310ebac3', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:23:17.307650 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:23:17.308106 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:23:17.308574 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:23:17.309153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:23:17.309568 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:23:17.320447 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:17.321230 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:17.322266 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:17.322808 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:17.340506 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Getting quotas for project 5e343d0e69de4a2c956a7ebc9056b8d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:23:17.345091 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Getting quotas for user d37b3b7824b24b328138061ae7af38f8 and project 5e343d0e69de4a2c956a7ebc9056b8d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:23:17.358372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:23:17.361154 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:23:17.533431 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-50d6303b-e28c-4c7d-9ce5-468c2526231b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759411 May 16 15:23:17.534353 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 406/812] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:23:17.546814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0162b4e2-3c3b-41a2-90a5-20e63050764d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:17.551849 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0162b4e2-3c3b-41a2-90a5-20e63050764d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:17.658468 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0162b4e2-3c3b-41a2-90a5-20e63050764d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:17.665148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0162b4e2-3c3b-41a2-90a5-20e63050764d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1219 microversion: 2.1 time: 0.122664 May 16 15:23:17.670716 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 407/813] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:17 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:18.689971 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b6ecee37-8188-45dd-b77a-d185b7953e8b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:18.692050 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b6ecee37-8188-45dd-b77a-d185b7953e8b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:18.711897 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6ecee37-8188-45dd-b77a-d185b7953e8b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:18.713180 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6ecee37-8188-45dd-b77a-d185b7953e8b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:18.714640 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6ecee37-8188-45dd-b77a-d185b7953e8b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:18.715542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6ecee37-8188-45dd-b77a-d185b7953e8b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:18.995335 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b6ecee37-8188-45dd-b77a-d185b7953e8b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:19.004548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b6ecee37-8188-45dd-b77a-d185b7953e8b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1223 microversion: 2.1 time: 0.322835 May 16 15:23:19.005403 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 407/814] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:18 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1223 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:20.024919 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3120efeb-d6de-42c3-a2af-fcc78c7d4740 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:20.025554 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3120efeb-d6de-42c3-a2af-fcc78c7d4740 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:20.034646 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3120efeb-d6de-42c3-a2af-fcc78c7d4740 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:20.034965 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3120efeb-d6de-42c3-a2af-fcc78c7d4740 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:20.035800 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3120efeb-d6de-42c3-a2af-fcc78c7d4740 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:20.036251 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3120efeb-d6de-42c3-a2af-fcc78c7d4740 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:20.151332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3120efeb-d6de-42c3-a2af-fcc78c7d4740 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:20.158869 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3120efeb-d6de-42c3-a2af-fcc78c7d4740 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1279 microversion: 2.1 time: 0.138313 May 16 15:23:20.159435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 408/815] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:20 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1279 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:21.176900 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3ba64b04-7df5-4026-a9b7-4e358d826b54 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:21.179264 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3ba64b04-7df5-4026-a9b7-4e358d826b54 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:21.188761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3ba64b04-7df5-4026-a9b7-4e358d826b54 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.189607 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3ba64b04-7df5-4026-a9b7-4e358d826b54 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.190608 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3ba64b04-7df5-4026-a9b7-4e358d826b54 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.191232 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3ba64b04-7df5-4026-a9b7-4e358d826b54 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.422284 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3ba64b04-7df5-4026-a9b7-4e358d826b54 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:21.437253 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3ba64b04-7df5-4026-a9b7-4e358d826b54 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1319 microversion: 2.1 time: 0.262803 May 16 15:23:21.439010 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 408/816] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:21 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:22.222332 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-1115e373-d3c1-43d7-b590-67985314e624 req-df26522e-d24a-40ba-adcc-71175da2395f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc996c8a-6e8c-417e-8afe-78c27b11b6e2", "tag": "90ca4e84-3dae-4f7c-8d88-f4d32d6f6fc6"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:22.231726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-1115e373-d3c1-43d7-b590-67985314e624 req-df26522e-d24a-40ba-adcc-71175da2395f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.233163 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-1115e373-d3c1-43d7-b590-67985314e624 req-df26522e-d24a-40ba-adcc-71175da2395f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.245711 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-1115e373-d3c1-43d7-b590-67985314e624 req-df26522e-d24a-40ba-adcc-71175da2395f service nova] Creating event network-changed:90ca4e84-3dae-4f7c-8d88-f4d32d6f6fc6 for instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 on hv-cinder-84175 May 16 15:23:22.251437 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-1115e373-d3c1-43d7-b590-67985314e624 req-df26522e-d24a-40ba-adcc-71175da2395f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035152 May 16 15:23:22.252636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 409/817] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:22.458663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-384e865b-8735-4285-ad1b-c36b82f2deb6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:22.459280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-384e865b-8735-4285-ad1b-c36b82f2deb6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:22.485648 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-384e865b-8735-4285-ad1b-c36b82f2deb6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.486074 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-384e865b-8735-4285-ad1b-c36b82f2deb6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.489191 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-384e865b-8735-4285-ad1b-c36b82f2deb6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.489191 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-384e865b-8735-4285-ad1b-c36b82f2deb6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.702407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-384e865b-8735-4285-ad1b-c36b82f2deb6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:22.710448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-384e865b-8735-4285-ad1b-c36b82f2deb6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1319 microversion: 2.1 time: 0.255493 May 16 15:23:22.711265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 409/818] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:22 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:23.728877 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f8edee05-04f0-4f5d-b528-07d3b4951ba3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:23.730181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f8edee05-04f0-4f5d-b528-07d3b4951ba3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:23.737280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f8edee05-04f0-4f5d-b528-07d3b4951ba3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:23.737731 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f8edee05-04f0-4f5d-b528-07d3b4951ba3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.738530 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f8edee05-04f0-4f5d-b528-07d3b4951ba3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:23.738950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f8edee05-04f0-4f5d-b528-07d3b4951ba3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.891851 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f8edee05-04f0-4f5d-b528-07d3b4951ba3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:23.899975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f8edee05-04f0-4f5d-b528-07d3b4951ba3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1319 microversion: 2.1 time: 0.175833 May 16 15:23:23.900556 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 410/819] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:23 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:24.917320 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-346a752e-9a93-4f21-8da4-0ce4ea6029e3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:24.918023 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-346a752e-9a93-4f21-8da4-0ce4ea6029e3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:24.924705 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-346a752e-9a93-4f21-8da4-0ce4ea6029e3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:24.925262 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-346a752e-9a93-4f21-8da4-0ce4ea6029e3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:24.926110 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-346a752e-9a93-4f21-8da4-0ce4ea6029e3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:24.926735 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-346a752e-9a93-4f21-8da4-0ce4ea6029e3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:25.064256 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-346a752e-9a93-4f21-8da4-0ce4ea6029e3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:25.075108 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-346a752e-9a93-4f21-8da4-0ce4ea6029e3 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1319 microversion: 2.1 time: 0.161660 May 16 15:23:25.076503 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 410/820] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:24 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:26.093825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-df7d3c9e-da0f-4f16-b539-49c8303b4b34 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:26.095217 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-df7d3c9e-da0f-4f16-b539-49c8303b4b34 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:26.102540 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-df7d3c9e-da0f-4f16-b539-49c8303b4b34 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.103048 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-df7d3c9e-da0f-4f16-b539-49c8303b4b34 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.104008 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-df7d3c9e-da0f-4f16-b539-49c8303b4b34 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.104440 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-df7d3c9e-da0f-4f16-b539-49c8303b4b34 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.251543 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-df7d3c9e-da0f-4f16-b539-49c8303b4b34 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:26.260347 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-df7d3c9e-da0f-4f16-b539-49c8303b4b34 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1319 microversion: 2.1 time: 0.171853 May 16 15:23:26.260910 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 411/821] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:26 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:26.797898 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-2fb2a846-6d13-4d76-b477-71fc105f4854 req-06c3b01e-9276-4237-b358-e6e83e258d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc996c8a-6e8c-417e-8afe-78c27b11b6e2", "name": "network-vif-plugged", "status": "completed", "tag": "90ca4e84-3dae-4f7c-8d88-f4d32d6f6fc6"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:26.806889 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-2fb2a846-6d13-4d76-b477-71fc105f4854 req-06c3b01e-9276-4237-b358-e6e83e258d39 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.807554 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-2fb2a846-6d13-4d76-b477-71fc105f4854 req-06c3b01e-9276-4237-b358-e6e83e258d39 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.824435 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-2fb2a846-6d13-4d76-b477-71fc105f4854 req-06c3b01e-9276-4237-b358-e6e83e258d39 service nova] Creating event network-vif-plugged:90ca4e84-3dae-4f7c-8d88-f4d32d6f6fc6 for instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 on hv-cinder-84175 May 16 15:23:26.824642 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-2fb2a846-6d13-4d76-b477-71fc105f4854 req-06c3b01e-9276-4237-b358-e6e83e258d39 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031387 May 16 15:23:26.825410 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 411/822] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:27.277871 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-650ba158-772d-49d7-9acc-603b02b6b96f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:27.278557 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-650ba158-772d-49d7-9acc-603b02b6b96f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:27.289175 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-650ba158-772d-49d7-9acc-603b02b6b96f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.290069 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-650ba158-772d-49d7-9acc-603b02b6b96f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.291288 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-650ba158-772d-49d7-9acc-603b02b6b96f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.292030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-650ba158-772d-49d7-9acc-603b02b6b96f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.434755 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-650ba158-772d-49d7-9acc-603b02b6b96f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:27.442741 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-650ba158-772d-49d7-9acc-603b02b6b96f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1319 microversion: 2.1 time: 0.169090 May 16 15:23:27.443673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 412/823] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:27 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:28.461462 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-33af0cdf-afee-4317-a694-0d8206a1f3a5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:28.462519 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-33af0cdf-afee-4317-a694-0d8206a1f3a5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:28.469883 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-33af0cdf-afee-4317-a694-0d8206a1f3a5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:28.470336 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-33af0cdf-afee-4317-a694-0d8206a1f3a5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:28.471112 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-33af0cdf-afee-4317-a694-0d8206a1f3a5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:28.471546 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-33af0cdf-afee-4317-a694-0d8206a1f3a5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:28.610524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-33af0cdf-afee-4317-a694-0d8206a1f3a5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:28.618396 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-33af0cdf-afee-4317-a694-0d8206a1f3a5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1319 microversion: 2.1 time: 0.161505 May 16 15:23:28.618993 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 412/824] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:28 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:29.634220 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dc2ee471-6253-4d56-82c4-4e309909dcb8 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:29.634866 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dc2ee471-6253-4d56-82c4-4e309909dcb8 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:29.641321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dc2ee471-6253-4d56-82c4-4e309909dcb8 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.641771 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dc2ee471-6253-4d56-82c4-4e309909dcb8 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.642542 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dc2ee471-6253-4d56-82c4-4e309909dcb8 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.642975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dc2ee471-6253-4d56-82c4-4e309909dcb8 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.781788 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dc2ee471-6253-4d56-82c4-4e309909dcb8 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:29.790176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dc2ee471-6253-4d56-82c4-4e309909dcb8 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1507 microversion: 2.1 time: 0.159545 May 16 15:23:29.791119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 413/825] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:23:29 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:57.358871 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-82789246-51fb-4c74-aebb-5f0e3e270443 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd103a9e-e638-45c8-9ea6-623180ecbd75", "device": "/dev/sdb"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:57.361739 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-82789246-51fb-4c74-aebb-5f0e3e270443 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:57.370310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-82789246-51fb-4c74-aebb-5f0e3e270443 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:57.371001 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-82789246-51fb-4c74-aebb-5f0e3e270443 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:57.372923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-82789246-51fb-4c74-aebb-5f0e3e270443 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:57.373296 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-82789246-51fb-4c74-aebb-5f0e3e270443 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:58.083488 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-82789246-51fb-4c74-aebb-5f0e3e270443 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "POST /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728889 May 16 15:23:58.100017 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 413/826] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:23:57 2022] POST /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:24.153241 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-10d19f40-e5a2-49d5-976f-5278114c6918 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:24.153822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-10d19f40-e5a2-49d5-976f-5278114c6918 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:24.160799 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-10d19f40-e5a2-49d5-976f-5278114c6918 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:24.161256 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-10d19f40-e5a2-49d5-976f-5278114c6918 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:24.162072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-10d19f40-e5a2-49d5-976f-5278114c6918 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:24.162516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-10d19f40-e5a2-49d5-976f-5278114c6918 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:24.256412 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-10d19f40-e5a2-49d5-976f-5278114c6918 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lazy-loading 'services' on Instance uuid cc996c8a-6e8c-417e-8afe-78c27b11b6e2 {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:24:24.466351 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-10d19f40-e5a2-49d5-976f-5278114c6918 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "DELETE /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2/os-volume_attachments/dd103a9e-e638-45c8-9ea6-623180ecbd75" status: 202 len: 0 microversion: 2.1 time: 0.317017 May 16 15:24:24.467170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 414/827] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:24:24 2022] DELETE /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2/os-volume_attachments/dd103a9e-e638-45c8-9ea6-623180ecbd75 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:24:26.258444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-fa5cec4d-b2eb-4f81-88d1-6f4b80fe901b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Action: 'create', calling method: .version_select at 0x7f0c83600d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-958374759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRriNlBBWE06hZKFIck9Nhe9RYji7izjHohvsnCWeD2nAm+yDyTqai3R458FRjDC7HPHSTNY/VBzdFgNj9p5FurP1Cp9nIFSQzzcCU0t1LEwfNxzcfnouxiIWA7+Nuziw=="}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:26.273167 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-fa5cec4d-b2eb-4f81-88d1-6f4b80fe901b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Getting quotas for project ae0f47501cc04e37bec6bfc3cd696ea9. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:26.276960 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-fa5cec4d-b2eb-4f81-88d1-6f4b80fe901b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Getting quotas for user 6cda1596ad5d4032827f9250a17f1235 and project ae0f47501cc04e37bec6bfc3cd696ea9. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:26.384165 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-fa5cec4d-b2eb-4f81-88d1-6f4b80fe901b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.130455 May 16 15:24:26.384781 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 414/828] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:24:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:26.433571 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1911667995", "imageRef": "8e3ffed6-2f6f-4d80-aac3-402b37b6e6c1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-958374759", "networks": [{"uuid": "293de11d-03a3-40b1-9415-67bde64c1b76"}]}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:26.483214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] validate_networks() for [('293de11d-03a3-40b1-9415-67bde64c1b76', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:24:26.843119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:24:26.844199 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:24:26.844698 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:24:26.845111 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:24:26.845522 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:24:26.854094 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:26.854546 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:26.855342 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:26.855826 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:26.872609 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Getting quotas for project ae0f47501cc04e37bec6bfc3cd696ea9. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:26.877596 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Getting quotas for user 6cda1596ad5d4032827f9250a17f1235 and project ae0f47501cc04e37bec6bfc3cd696ea9. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:26.888232 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:24:26.891189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e3ffed6-2f6f-4d80-aac3-402b37b6e6c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:24:27.016546 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f58aace0-d23d-4211-937e-e71ee60f3159 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587673 May 16 15:24:27.017470 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 415/829] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:24:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:24:27.028119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-33ee9c20-1e33-4482-bd44-18920e7c6a24 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:27.028851 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-33ee9c20-1e33-4482-bd44-18920e7c6a24 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:27.088188 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-33ee9c20-1e33-4482-bd44-18920e7c6a24 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:27.097218 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-33ee9c20-1e33-4482-bd44-18920e7c6a24 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1258 microversion: 2.1 time: 0.073221 May 16 15:24:27.097889 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 415/830] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:27 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:28.114787 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6765acc6-f529-4b51-a5b4-a9585a35ec8f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:28.115656 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6765acc6-f529-4b51-a5b4-a9585a35ec8f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:28.122532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6765acc6-f529-4b51-a5b4-a9585a35ec8f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:28.122984 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6765acc6-f529-4b51-a5b4-a9585a35ec8f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:28.123814 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6765acc6-f529-4b51-a5b4-a9585a35ec8f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:28.124250 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6765acc6-f529-4b51-a5b4-a9585a35ec8f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:28.190072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6765acc6-f529-4b51-a5b4-a9585a35ec8f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:28.197620 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6765acc6-f529-4b51-a5b4-a9585a35ec8f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1262 microversion: 2.1 time: 0.086728 May 16 15:24:28.198179 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 416/831] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:28 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:29.214079 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-db528ead-368b-40f3-8df3-e01025434921 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:29.214691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-db528ead-368b-40f3-8df3-e01025434921 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:29.222223 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db528ead-368b-40f3-8df3-e01025434921 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:29.222667 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db528ead-368b-40f3-8df3-e01025434921 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:29.223415 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db528ead-368b-40f3-8df3-e01025434921 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:29.223873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-db528ead-368b-40f3-8df3-e01025434921 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:29.282926 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-db528ead-368b-40f3-8df3-e01025434921 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:29.289997 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-db528ead-368b-40f3-8df3-e01025434921 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1262 microversion: 2.1 time: 0.079703 May 16 15:24:29.290550 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 416/832] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:29 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:30.308747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-53ec9321-fd4f-4fd6-b2ce-dbf5ac1deffa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:30.309754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-53ec9321-fd4f-4fd6-b2ce-dbf5ac1deffa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:30.316052 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53ec9321-fd4f-4fd6-b2ce-dbf5ac1deffa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:30.316557 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53ec9321-fd4f-4fd6-b2ce-dbf5ac1deffa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:30.317358 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53ec9321-fd4f-4fd6-b2ce-dbf5ac1deffa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:30.317974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53ec9321-fd4f-4fd6-b2ce-dbf5ac1deffa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:30.378214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-53ec9321-fd4f-4fd6-b2ce-dbf5ac1deffa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:30.385492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-53ec9321-fd4f-4fd6-b2ce-dbf5ac1deffa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1254 microversion: 2.1 time: 0.082074 May 16 15:24:30.386028 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 417/833] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:30 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1254 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:30.870568 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-55260f00-7364-401a-8539-cb71272f66e7 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:30.871076 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-55260f00-7364-401a-8539-cb71272f66e7 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:30.877994 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55260f00-7364-401a-8539-cb71272f66e7 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:30.878448 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55260f00-7364-401a-8539-cb71272f66e7 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:30.879223 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55260f00-7364-401a-8539-cb71272f66e7 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:30.879686 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55260f00-7364-401a-8539-cb71272f66e7 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:30.905115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-55260f00-7364-401a-8539-cb71272f66e7 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:24:31.191466 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-55260f00-7364-401a-8539-cb71272f66e7 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "DELETE /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 204 len: 0 microversion: 2.1 time: 0.324451 May 16 15:24:31.199483 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 417/834] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:24:30 2022] DELETE /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:24:31.208368 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-57202b37-54b8-4e47-9028-97143b5d00b0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:31.209003 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-57202b37-54b8-4e47-9028-97143b5d00b0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:31.214984 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-57202b37-54b8-4e47-9028-97143b5d00b0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:31.215427 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-57202b37-54b8-4e47-9028-97143b5d00b0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.216219 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-57202b37-54b8-4e47-9028-97143b5d00b0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:31.216650 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-57202b37-54b8-4e47-9028-97143b5d00b0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.411471 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d28f09ac-ad32-4fb3-aa46-b748ca9ffb54 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:31.412539 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d28f09ac-ad32-4fb3-aa46-b748ca9ffb54 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:31.412914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-57202b37-54b8-4e47-9028-97143b5d00b0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:31.418622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d28f09ac-ad32-4fb3-aa46-b748ca9ffb54 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:31.419068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d28f09ac-ad32-4fb3-aa46-b748ca9ffb54 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.419864 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d28f09ac-ad32-4fb3-aa46-b748ca9ffb54 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:31.420297 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d28f09ac-ad32-4fb3-aa46-b748ca9ffb54 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.420478 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-57202b37-54b8-4e47-9028-97143b5d00b0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1513 microversion: 2.1 time: 0.216085 May 16 15:24:31.421568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 418/835] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:31 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:31.493735 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d28f09ac-ad32-4fb3-aa46-b748ca9ffb54 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:31.502822 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d28f09ac-ad32-4fb3-aa46-b748ca9ffb54 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1328 microversion: 2.1 time: 0.095534 May 16 15:24:31.509224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 418/836] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:31 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:32.438935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8eac949f-374f-42c2-8c80-508cbe7f3ce5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:32.439572 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8eac949f-374f-42c2-8c80-508cbe7f3ce5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:32.446398 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8eac949f-374f-42c2-8c80-508cbe7f3ce5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.446850 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8eac949f-374f-42c2-8c80-508cbe7f3ce5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.447619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8eac949f-374f-42c2-8c80-508cbe7f3ce5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.448105 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8eac949f-374f-42c2-8c80-508cbe7f3ce5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.520956 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-fcb4f8c0-23d7-4463-83e3-aeba8ee01378 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:32.521924 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-fcb4f8c0-23d7-4463-83e3-aeba8ee01378 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:32.528663 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fcb4f8c0-23d7-4463-83e3-aeba8ee01378 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.529104 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fcb4f8c0-23d7-4463-83e3-aeba8ee01378 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.529882 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fcb4f8c0-23d7-4463-83e3-aeba8ee01378 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.530315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-fcb4f8c0-23d7-4463-83e3-aeba8ee01378 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.736822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8eac949f-374f-42c2-8c80-508cbe7f3ce5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.744673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8eac949f-374f-42c2-8c80-508cbe7f3ce5 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1513 microversion: 2.1 time: 0.310240 May 16 15:24:32.745421 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 419/837] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:32 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:32.825556 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-fcb4f8c0-23d7-4463-83e3-aeba8ee01378 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.833343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-fcb4f8c0-23d7-4463-83e3-aeba8ee01378 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1370 microversion: 2.1 time: 0.316387 May 16 15:24:32.843668 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 419/838] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:32 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1370 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:33.762347 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fa6de4e7-54d0-40a0-81f9-619d0b544aa4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:33.762966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fa6de4e7-54d0-40a0-81f9-619d0b544aa4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:33.771158 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fa6de4e7-54d0-40a0-81f9-619d0b544aa4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.772449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fa6de4e7-54d0-40a0-81f9-619d0b544aa4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.773579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fa6de4e7-54d0-40a0-81f9-619d0b544aa4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.774308 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fa6de4e7-54d0-40a0-81f9-619d0b544aa4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.851894 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d3867663-ed5d-455a-9a48-29b690cecde8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:33.852513 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d3867663-ed5d-455a-9a48-29b690cecde8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:33.872487 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3867663-ed5d-455a-9a48-29b690cecde8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.876686 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3867663-ed5d-455a-9a48-29b690cecde8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.878602 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3867663-ed5d-455a-9a48-29b690cecde8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.879498 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d3867663-ed5d-455a-9a48-29b690cecde8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.892952 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-fa6de4e7-54d0-40a0-81f9-619d0b544aa4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:33.902599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-fa6de4e7-54d0-40a0-81f9-619d0b544aa4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1471 microversion: 2.1 time: 0.144512 May 16 15:24:33.921995 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 420/839] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:33 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:34.027508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-fe3d506b-de38-4772-9ffa-19b84acfd3c6 req-789084ef-8987-4e42-9d54-0f560299a723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc996c8a-6e8c-417e-8afe-78c27b11b6e2", "name": "network-vif-deleted", "tag": "90ca4e84-3dae-4f7c-8d88-f4d32d6f6fc6"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:34.040708 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-fe3d506b-de38-4772-9ffa-19b84acfd3c6 req-789084ef-8987-4e42-9d54-0f560299a723 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:34.041512 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-fe3d506b-de38-4772-9ffa-19b84acfd3c6 req-789084ef-8987-4e42-9d54-0f560299a723 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:34.074391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-fe3d506b-de38-4772-9ffa-19b84acfd3c6 req-789084ef-8987-4e42-9d54-0f560299a723 service nova] Creating event network-vif-deleted:90ca4e84-3dae-4f7c-8d88-f4d32d6f6fc6 for instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 on hv-cinder-84175 May 16 15:24:34.096535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-fe3d506b-de38-4772-9ffa-19b84acfd3c6 req-789084ef-8987-4e42-9d54-0f560299a723 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072678 May 16 15:24:34.099288 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 421/840] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:34.190459 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d3867663-ed5d-455a-9a48-29b690cecde8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:34.198924 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d3867663-ed5d-455a-9a48-29b690cecde8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.350707 May 16 15:24:34.199497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 420/841] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:33 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:34.929388 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4d9ccdee-9a9e-4363-839d-f3c374801616 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:34.930096 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4d9ccdee-9a9e-4363-839d-f3c374801616 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:34.936286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4d9ccdee-9a9e-4363-839d-f3c374801616 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:34.936744 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4d9ccdee-9a9e-4363-839d-f3c374801616 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:34.937568 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4d9ccdee-9a9e-4363-839d-f3c374801616 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:34.938001 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4d9ccdee-9a9e-4363-839d-f3c374801616 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:35.006211 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4d9ccdee-9a9e-4363-839d-f3c374801616 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:35.014602 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4d9ccdee-9a9e-4363-839d-f3c374801616 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1471 microversion: 2.1 time: 0.089789 May 16 15:24:35.016060 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 422/842] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:34 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:35.219602 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ae7cb6da-5475-44f4-8242-aed078d43fcb tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:35.220250 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ae7cb6da-5475-44f4-8242-aed078d43fcb tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:35.226717 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ae7cb6da-5475-44f4-8242-aed078d43fcb tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:35.227167 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ae7cb6da-5475-44f4-8242-aed078d43fcb tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:35.227958 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ae7cb6da-5475-44f4-8242-aed078d43fcb tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:35.228389 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ae7cb6da-5475-44f4-8242-aed078d43fcb tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:35.366161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ae7cb6da-5475-44f4-8242-aed078d43fcb tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:35.376281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ae7cb6da-5475-44f4-8242-aed078d43fcb tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.161154 May 16 15:24:35.377062 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 421/843] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:35 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:36.032925 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-18826453-f7de-4d14-8cb4-09c822f5bc4c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:36.033719 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-18826453-f7de-4d14-8cb4-09c822f5bc4c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:36.040171 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-18826453-f7de-4d14-8cb4-09c822f5bc4c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.040629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-18826453-f7de-4d14-8cb4-09c822f5bc4c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.041400 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-18826453-f7de-4d14-8cb4-09c822f5bc4c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.041842 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-18826453-f7de-4d14-8cb4-09c822f5bc4c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.134762 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-18826453-f7de-4d14-8cb4-09c822f5bc4c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.135230 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-c64ba3d3-f293-4ec1-8a2f-f97ac89ae85a req-a1b2bcb3-926c-45ca-bcb6-ffd9215b5556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049aa153-31aa-449b-86ad-d9e47d70e18b", "tag": "26abdd01-015f-4c88-b71f-2308c1053124"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:36.144205 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-18826453-f7de-4d14-8cb4-09c822f5bc4c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1471 microversion: 2.1 time: 0.115338 May 16 15:24:36.154905 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 423/844] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:36 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1471 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:36.155166 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-c64ba3d3-f293-4ec1-8a2f-f97ac89ae85a req-a1b2bcb3-926c-45ca-bcb6-ffd9215b5556 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.155166 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-c64ba3d3-f293-4ec1-8a2f-f97ac89ae85a req-a1b2bcb3-926c-45ca-bcb6-ffd9215b5556 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.169812 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-c64ba3d3-f293-4ec1-8a2f-f97ac89ae85a req-a1b2bcb3-926c-45ca-bcb6-ffd9215b5556 service nova] Creating event network-changed:26abdd01-015f-4c88-b71f-2308c1053124 for instance 049aa153-31aa-449b-86ad-d9e47d70e18b on hv-cinder-84175 May 16 15:24:36.176480 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-c64ba3d3-f293-4ec1-8a2f-f97ac89ae85a req-a1b2bcb3-926c-45ca-bcb6-ffd9215b5556 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045588 May 16 15:24:36.177343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 422/845] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:24:36.394929 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-77d815e7-bf3b-41d1-889d-1b21105e07a0 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:36.395999 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-77d815e7-bf3b-41d1-889d-1b21105e07a0 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:36.402376 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-77d815e7-bf3b-41d1-889d-1b21105e07a0 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.419816 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-77d815e7-bf3b-41d1-889d-1b21105e07a0 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.419816 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-77d815e7-bf3b-41d1-889d-1b21105e07a0 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.419816 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-77d815e7-bf3b-41d1-889d-1b21105e07a0 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.551289 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-77d815e7-bf3b-41d1-889d-1b21105e07a0 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.559974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-77d815e7-bf3b-41d1-889d-1b21105e07a0 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.170077 May 16 15:24:36.570311 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 424/846] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:36 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:37.163429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-690ebbf2-862f-423d-93d7-394e38b96669 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:37.164194 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-690ebbf2-862f-423d-93d7-394e38b96669 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:37.170617 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-690ebbf2-862f-423d-93d7-394e38b96669 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.171742 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-690ebbf2-862f-423d-93d7-394e38b96669 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.172543 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-690ebbf2-862f-423d-93d7-394e38b96669 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.172977 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-690ebbf2-862f-423d-93d7-394e38b96669 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.235938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-690ebbf2-862f-423d-93d7-394e38b96669 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:37.243321 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-690ebbf2-862f-423d-93d7-394e38b96669 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1471 microversion: 2.1 time: 0.084656 May 16 15:24:37.243855 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 423/847] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:37 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:37.577105 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2e604b47-c699-4b88-ad1e-a12fdc79914a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:37.578031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2e604b47-c699-4b88-ad1e-a12fdc79914a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:37.584799 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2e604b47-c699-4b88-ad1e-a12fdc79914a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.585250 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2e604b47-c699-4b88-ad1e-a12fdc79914a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.586148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2e604b47-c699-4b88-ad1e-a12fdc79914a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.586584 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2e604b47-c699-4b88-ad1e-a12fdc79914a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.739580 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2e604b47-c699-4b88-ad1e-a12fdc79914a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:37.747139 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2e604b47-c699-4b88-ad1e-a12fdc79914a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.173874 May 16 15:24:37.747719 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 425/848] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:37 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:38.260774 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-30ba4e65-ee13-4c3e-9c85-f4239982175a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:38.261581 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-30ba4e65-ee13-4c3e-9c85-f4239982175a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:38.268991 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-30ba4e65-ee13-4c3e-9c85-f4239982175a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.269444 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-30ba4e65-ee13-4c3e-9c85-f4239982175a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.270228 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-30ba4e65-ee13-4c3e-9c85-f4239982175a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.270675 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-30ba4e65-ee13-4c3e-9c85-f4239982175a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.331516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-30ba4e65-ee13-4c3e-9c85-f4239982175a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.338973 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-30ba4e65-ee13-4c3e-9c85-f4239982175a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1471 microversion: 2.1 time: 0.082128 May 16 15:24:38.339537 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 424/849] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:38 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1471 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:38.763733 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-52e596da-e75b-4919-aa0f-49add152b1ad tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:38.764346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-52e596da-e75b-4919-aa0f-49add152b1ad tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:38.772217 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52e596da-e75b-4919-aa0f-49add152b1ad tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.772673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52e596da-e75b-4919-aa0f-49add152b1ad tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.773453 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52e596da-e75b-4919-aa0f-49add152b1ad tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.773895 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52e596da-e75b-4919-aa0f-49add152b1ad tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.913318 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-52e596da-e75b-4919-aa0f-49add152b1ad tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.921898 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-52e596da-e75b-4919-aa0f-49add152b1ad tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.161839 May 16 15:24:38.922478 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 426/850] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:38 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:39.355972 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-40485bfb-a23d-435d-9b1b-237405943e90 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:39.356568 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-40485bfb-a23d-435d-9b1b-237405943e90 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:39.363720 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-40485bfb-a23d-435d-9b1b-237405943e90 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.366732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-40485bfb-a23d-435d-9b1b-237405943e90 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.366732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-40485bfb-a23d-435d-9b1b-237405943e90 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.366732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-40485bfb-a23d-435d-9b1b-237405943e90 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.429479 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-40485bfb-a23d-435d-9b1b-237405943e90 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.436734 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-40485bfb-a23d-435d-9b1b-237405943e90 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1471 microversion: 2.1 time: 0.084646 May 16 15:24:39.437849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 425/851] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:39 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:39.938641 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-54ac8985-cada-471d-aef6-f7687297506a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:39.939994 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-54ac8985-cada-471d-aef6-f7687297506a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:39.946711 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-54ac8985-cada-471d-aef6-f7687297506a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.947172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-54ac8985-cada-471d-aef6-f7687297506a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.948007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-54ac8985-cada-471d-aef6-f7687297506a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.948434 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-54ac8985-cada-471d-aef6-f7687297506a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.074859 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-54ac8985-cada-471d-aef6-f7687297506a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:40.083174 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-54ac8985-cada-471d-aef6-f7687297506a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.148442 May 16 15:24:40.083768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 427/852] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:39 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:40.454065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7b3bc234-060a-4b43-b978-8554cbdc2707 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:40.454727 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7b3bc234-060a-4b43-b978-8554cbdc2707 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:40.460979 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7b3bc234-060a-4b43-b978-8554cbdc2707 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.461423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7b3bc234-060a-4b43-b978-8554cbdc2707 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.462180 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7b3bc234-060a-4b43-b978-8554cbdc2707 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.462606 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7b3bc234-060a-4b43-b978-8554cbdc2707 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.532733 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7b3bc234-060a-4b43-b978-8554cbdc2707 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:40.541148 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7b3bc234-060a-4b43-b978-8554cbdc2707 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1471 microversion: 2.1 time: 0.090864 May 16 15:24:40.542073 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 426/853] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:40 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:41.099174 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b86b001a-0a38-47f2-b4c3-5822f42b6c1d tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:41.099781 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b86b001a-0a38-47f2-b4c3-5822f42b6c1d tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:41.106501 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b86b001a-0a38-47f2-b4c3-5822f42b6c1d tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.106957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b86b001a-0a38-47f2-b4c3-5822f42b6c1d tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.107780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b86b001a-0a38-47f2-b4c3-5822f42b6c1d tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.108226 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b86b001a-0a38-47f2-b4c3-5822f42b6c1d tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.253060 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b86b001a-0a38-47f2-b4c3-5822f42b6c1d tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:41.260037 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b86b001a-0a38-47f2-b4c3-5822f42b6c1d tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.164863 May 16 15:24:41.260593 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 428/854] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:41 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:41.558028 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e120652f-8c3b-4b88-935f-91d320b95f14 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:41.558759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e120652f-8c3b-4b88-935f-91d320b95f14 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:41.565419 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e120652f-8c3b-4b88-935f-91d320b95f14 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.565876 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e120652f-8c3b-4b88-935f-91d320b95f14 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.566658 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e120652f-8c3b-4b88-935f-91d320b95f14 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.567101 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e120652f-8c3b-4b88-935f-91d320b95f14 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.630798 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e120652f-8c3b-4b88-935f-91d320b95f14 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:41.639518 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e120652f-8c3b-4b88-935f-91d320b95f14 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1471 microversion: 2.1 time: 0.085246 May 16 15:24:41.640182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 427/855] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:41 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1471 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:42.278343 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-dda4a36e-b726-4431-b3d0-b1322ffdef1a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:42.278977 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-dda4a36e-b726-4431-b3d0-b1322ffdef1a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:42.286129 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dda4a36e-b726-4431-b3d0-b1322ffdef1a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.286577 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dda4a36e-b726-4431-b3d0-b1322ffdef1a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.287358 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dda4a36e-b726-4431-b3d0-b1322ffdef1a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.287835 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-dda4a36e-b726-4431-b3d0-b1322ffdef1a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.496222 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-dda4a36e-b726-4431-b3d0-b1322ffdef1a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:42.504537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-dda4a36e-b726-4431-b3d0-b1322ffdef1a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.230013 May 16 15:24:42.505204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 429/856] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:42 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:42.657145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:42.657732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:42.663990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.664465 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.665219 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.665649 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.695939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.696385 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.696849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lazy-loading 'fault' on Instance uuid cc996c8a-6e8c-417e-8afe-78c27b11b6e2 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:24:42.738019 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:42.745413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-aa8cf12c-3482-49c1-80fe-334058c36b13 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 200 len: 1309 microversion: 2.1 time: 0.092213 May 16 15:24:42.759977 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 428/857] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:42 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:43.522411 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-964a5a54-11eb-4d74-9510-23b12f740f14 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:43.522967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-964a5a54-11eb-4d74-9510-23b12f740f14 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:43.529231 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-964a5a54-11eb-4d74-9510-23b12f740f14 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.529703 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-964a5a54-11eb-4d74-9510-23b12f740f14 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.530526 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-964a5a54-11eb-4d74-9510-23b12f740f14 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.530980 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-964a5a54-11eb-4d74-9510-23b12f740f14 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.660639 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-964a5a54-11eb-4d74-9510-23b12f740f14 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:43.667868 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-964a5a54-11eb-4d74-9510-23b12f740f14 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.149663 May 16 15:24:43.668426 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 430/858] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:43 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:43.762132 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:43.762759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: cc996c8a-6e8c-417e-8afe-78c27b11b6e2] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:43.769662 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.770109 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.770869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.771552 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.785225 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] HTTP exception thrown: Instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 could not be found. May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Request method failure captured: May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 HTTP/1.1 May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmxiIRUsI_avqvqIXOdBLGvgs_UzpLVMaSrxIqLcTERhpnv7YZBRAMjbsXYI8-lECImt5lsDSsMur7RJ0ZZydfe6pSwCuVA9TcreU-qAxbvLCsUI-zOKnQYZTLpYNP6JiW1NfzsWsz1pYeh1dTHdzaMLgruD7mF_faNXQVTCEVXUS6s May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 5e343d0e69de4a2c956a7ebc9056b8d5 May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1260477555 May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:24:43.786778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e343d0e69de4a2c956a7ebc9056b8d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5e343d0e69de4a2c956a7ebc9056b8d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5e343d0e69de4a2c956a7ebc9056b8d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e343d0e69de4a2c956a7ebc9056b8d5"}]}] May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-VolumesSnapshotTestJSON-1260477555 May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 5e343d0e69de4a2c956a7ebc9056b8d5 May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1260477555 May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-VolumesSnapshotTestJSON-1260477555-project May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: d37b3b7824b24b328138061ae7af38f8 May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-VolumesSnapshotTestJSON-1260477555-project May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 could not be found. May 16 15:24:43.788497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': 'cc996c8a-6e8c-417e-8afe-78c27b11b6e2'} May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 could not be found. May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:24:43.789516 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 could not be found. May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 could not be found. May 16 15:24:43.791196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:24:43.792682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Returning 404 to user: Instance cc996c8a-6e8c-417e-8afe-78c27b11b6e2 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:24:43.792682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-752869b0-a8ad-488f-abfe-e4fd2c7fb1e9 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2" status: 404 len: 111 microversion: 2.1 time: 0.029904 May 16 15:24:43.792682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 429/859] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:43 2022] GET /compute/v2.1/servers/cc996c8a-6e8c-417e-8afe-78c27b11b6e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:24:44.684562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4cafe795-f655-4ce8-aa3f-69e1d3391117 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:44.685170 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4cafe795-f655-4ce8-aa3f-69e1d3391117 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:44.692270 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4cafe795-f655-4ce8-aa3f-69e1d3391117 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:44.692712 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4cafe795-f655-4ce8-aa3f-69e1d3391117 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:44.693467 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4cafe795-f655-4ce8-aa3f-69e1d3391117 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:44.693899 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4cafe795-f655-4ce8-aa3f-69e1d3391117 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:44.818111 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4cafe795-f655-4ce8-aa3f-69e1d3391117 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:44.825262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4cafe795-f655-4ce8-aa3f-69e1d3391117 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.144658 May 16 15:24:44.825822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 431/860] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:44 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:45.842043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-20be4b24-e6de-473f-a8d2-4343431d801a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:45.842654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-20be4b24-e6de-473f-a8d2-4343431d801a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:45.849126 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-20be4b24-e6de-473f-a8d2-4343431d801a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:45.849578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-20be4b24-e6de-473f-a8d2-4343431d801a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.850343 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-20be4b24-e6de-473f-a8d2-4343431d801a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:45.850781 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-20be4b24-e6de-473f-a8d2-4343431d801a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.978611 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-20be4b24-e6de-473f-a8d2-4343431d801a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:45.985830 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-20be4b24-e6de-473f-a8d2-4343431d801a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.147567 May 16 15:24:45.986362 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 430/861] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:45 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:47.002580 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d045de29-fbc5-4898-b1fb-5c1e23bb76aa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:47.003200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d045de29-fbc5-4898-b1fb-5c1e23bb76aa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:47.009705 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d045de29-fbc5-4898-b1fb-5c1e23bb76aa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.010162 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d045de29-fbc5-4898-b1fb-5c1e23bb76aa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.010930 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d045de29-fbc5-4898-b1fb-5c1e23bb76aa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.011364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d045de29-fbc5-4898-b1fb-5c1e23bb76aa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.137140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d045de29-fbc5-4898-b1fb-5c1e23bb76aa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:47.145099 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d045de29-fbc5-4898-b1fb-5c1e23bb76aa tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.146384 May 16 15:24:47.145707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 432/862] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:46 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:48.162800 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-afd8586c-7e91-4e54-ad92-00b8bcfbb333 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:48.163596 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-afd8586c-7e91-4e54-ad92-00b8bcfbb333 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:48.169918 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-afd8586c-7e91-4e54-ad92-00b8bcfbb333 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.170362 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-afd8586c-7e91-4e54-ad92-00b8bcfbb333 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.171128 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-afd8586c-7e91-4e54-ad92-00b8bcfbb333 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.171560 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-afd8586c-7e91-4e54-ad92-00b8bcfbb333 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.254312 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-210e66c7-a1c8-4905-bfda-6446b09db99b req-96942973-b802-4fc4-9b39-7e51c85f8cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049aa153-31aa-449b-86ad-d9e47d70e18b", "name": "network-vif-plugged", "status": "completed", "tag": "26abdd01-015f-4c88-b71f-2308c1053124"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:48.262640 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-210e66c7-a1c8-4905-bfda-6446b09db99b req-96942973-b802-4fc4-9b39-7e51c85f8cb3 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.263086 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-210e66c7-a1c8-4905-bfda-6446b09db99b req-96942973-b802-4fc4-9b39-7e51c85f8cb3 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.275127 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-210e66c7-a1c8-4905-bfda-6446b09db99b req-96942973-b802-4fc4-9b39-7e51c85f8cb3 service nova] Creating event network-vif-plugged:26abdd01-015f-4c88-b71f-2308c1053124 for instance 049aa153-31aa-449b-86ad-d9e47d70e18b on hv-cinder-84175 May 16 15:24:48.280286 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-210e66c7-a1c8-4905-bfda-6446b09db99b req-96942973-b802-4fc4-9b39-7e51c85f8cb3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030385 May 16 15:24:48.280823 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 433/863] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:48.301401 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-afd8586c-7e91-4e54-ad92-00b8bcfbb333 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:48.308872 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-afd8586c-7e91-4e54-ad92-00b8bcfbb333 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.149940 May 16 15:24:48.309432 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 431/864] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:48 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:49.326688 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-405c0cfe-130c-4b58-b0ad-81aa5ecc5a57 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:49.327306 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-405c0cfe-130c-4b58-b0ad-81aa5ecc5a57 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:49.333957 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-405c0cfe-130c-4b58-b0ad-81aa5ecc5a57 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:49.334402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-405c0cfe-130c-4b58-b0ad-81aa5ecc5a57 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:49.335195 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-405c0cfe-130c-4b58-b0ad-81aa5ecc5a57 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:49.335653 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-405c0cfe-130c-4b58-b0ad-81aa5ecc5a57 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:49.461273 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-405c0cfe-130c-4b58-b0ad-81aa5ecc5a57 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:49.468523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-405c0cfe-130c-4b58-b0ad-81aa5ecc5a57 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.146592 May 16 15:24:49.469090 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 434/865] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:49 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:50.486008 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-997642af-7e12-4591-9e4d-bfcfe06b15ed tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:50.486674 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-997642af-7e12-4591-9e4d-bfcfe06b15ed tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:50.493035 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-997642af-7e12-4591-9e4d-bfcfe06b15ed tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.493482 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-997642af-7e12-4591-9e4d-bfcfe06b15ed tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.494245 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-997642af-7e12-4591-9e4d-bfcfe06b15ed tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.494680 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-997642af-7e12-4591-9e4d-bfcfe06b15ed tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.621769 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-997642af-7e12-4591-9e4d-bfcfe06b15ed tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:50.629507 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-997642af-7e12-4591-9e4d-bfcfe06b15ed tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.147402 May 16 15:24:50.630070 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 432/866] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:50 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:51.646322 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d183c43e-6311-49fa-9334-71fdd166ada8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:51.646924 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d183c43e-6311-49fa-9334-71fdd166ada8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:51.653317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d183c43e-6311-49fa-9334-71fdd166ada8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.653770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d183c43e-6311-49fa-9334-71fdd166ada8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.654536 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d183c43e-6311-49fa-9334-71fdd166ada8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.654970 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d183c43e-6311-49fa-9334-71fdd166ada8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.779812 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d183c43e-6311-49fa-9334-71fdd166ada8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:51.787610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d183c43e-6311-49fa-9334-71fdd166ada8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1358 microversion: 2.1 time: 0.145353 May 16 15:24:51.788206 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 435/867] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:51 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:52.070108 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1339535661", "imageRef": "f6488896-eeda-4386-a17f-d529605595e5", "flavorRef": "452", "networks": [{"uuid": "2aa68265-e33f-4bb0-af32-8089310ebac3"}]}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:52.122423 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] validate_networks() for [('2aa68265-e33f-4bb0-af32-8089310ebac3', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:24:52.459447 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:24:52.459912 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:24:52.460410 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:24:52.460816 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:24:52.461226 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:24:52.469580 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.474656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.474656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.474656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.488532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Getting quotas for project 5e343d0e69de4a2c956a7ebc9056b8d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:52.492345 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Getting quotas for user d37b3b7824b24b328138061ae7af38f8 and project 5e343d0e69de4a2c956a7ebc9056b8d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:52.503987 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:24:52.508770 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6488896-eeda-4386-a17f-d529605595e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:24:52.615310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-bf739489-533d-4b33-bda7-5e2e6d05d649 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549052 May 16 15:24:52.616057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 433/868] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:24:52.625741 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-10a891b2-c994-4de0-a778-bbbb1e34d1c2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:52.627020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-10a891b2-c994-4de0-a778-bbbb1e34d1c2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:52.680066 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-10a891b2-c994-4de0-a778-bbbb1e34d1c2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:52.686451 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-10a891b2-c994-4de0-a778-bbbb1e34d1c2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1219 microversion: 2.1 time: 0.064583 May 16 15:24:52.687010 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 436/869] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:52 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:52.804761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-78733514-ff79-407e-9177-8d3e35227803 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:52.805412 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-78733514-ff79-407e-9177-8d3e35227803 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:52.812171 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78733514-ff79-407e-9177-8d3e35227803 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.812625 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78733514-ff79-407e-9177-8d3e35227803 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.813453 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78733514-ff79-407e-9177-8d3e35227803 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.814396 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-78733514-ff79-407e-9177-8d3e35227803 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.946589 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-78733514-ff79-407e-9177-8d3e35227803 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:52.954083 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-78733514-ff79-407e-9177-8d3e35227803 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1548 microversion: 2.1 time: 0.153148 May 16 15:24:52.956065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 434/870] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:52 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:52.970080 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2f5cdce9-bf4b-47a5-afc7-cf816d6a1ac1 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:52.970725 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2f5cdce9-bf4b-47a5-afc7-cf816d6a1ac1 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:52.976603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2f5cdce9-bf4b-47a5-afc7-cf816d6a1ac1 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.977046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2f5cdce9-bf4b-47a5-afc7-cf816d6a1ac1 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.977801 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2f5cdce9-bf4b-47a5-afc7-cf816d6a1ac1 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.978231 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2f5cdce9-bf4b-47a5-afc7-cf816d6a1ac1 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.105635 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2f5cdce9-bf4b-47a5-afc7-cf816d6a1ac1 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.113905 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2f5cdce9-bf4b-47a5-afc7-cf816d6a1ac1 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1548 microversion: 2.1 time: 0.147562 May 16 15:24:53.114462 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 437/871] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:52 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:53.130199 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:53.133783 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.134548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Searching by: {'deleted': False, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9'} {{(pid=117677) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 15:24:53.141548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.142622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.143542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.144005 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.233953 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.multi_cell_list [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117677) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 15:24:53.326916 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-12e6a801-72d2-428c-93f3-72cb5e2e6d4f tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201210 May 16 15:24:53.327421 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 435/872] 10.222.0.71 () {58 vars in 1124 bytes} [Mon May 16 15:24:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:53.338331 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-53766db3-9bf7-4629-a242-33485a91f184 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:53.338955 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-53766db3-9bf7-4629-a242-33485a91f184 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:53.345557 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53766db3-9bf7-4629-a242-33485a91f184 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.346020 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53766db3-9bf7-4629-a242-33485a91f184 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.346797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53766db3-9bf7-4629-a242-33485a91f184 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.347242 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53766db3-9bf7-4629-a242-33485a91f184 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.477669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-53766db3-9bf7-4629-a242-33485a91f184 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.485600 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-53766db3-9bf7-4629-a242-33485a91f184 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1548 microversion: 2.1 time: 0.151088 May 16 15:24:53.486717 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 438/873] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:53 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:53.705862 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-49d057f1-5365-4c77-bfa7-7eebb9340b56 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:53.706586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-49d057f1-5365-4c77-bfa7-7eebb9340b56 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:53.713207 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-49d057f1-5365-4c77-bfa7-7eebb9340b56 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.713669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-49d057f1-5365-4c77-bfa7-7eebb9340b56 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.714414 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-49d057f1-5365-4c77-bfa7-7eebb9340b56 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.714844 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-49d057f1-5365-4c77-bfa7-7eebb9340b56 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.779256 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-49d057f1-5365-4c77-bfa7-7eebb9340b56 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.787543 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-49d057f1-5365-4c77-bfa7-7eebb9340b56 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1215 microversion: 2.1 time: 0.087693 May 16 15:24:53.788130 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 436/874] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:53 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:54.807413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-44d2b1ac-aefd-4e6b-9cf4-83f6c173039a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:54.808138 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-44d2b1ac-aefd-4e6b-9cf4-83f6c173039a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:54.814533 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-44d2b1ac-aefd-4e6b-9cf4-83f6c173039a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.814984 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-44d2b1ac-aefd-4e6b-9cf4-83f6c173039a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.815806 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-44d2b1ac-aefd-4e6b-9cf4-83f6c173039a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.816243 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-44d2b1ac-aefd-4e6b-9cf4-83f6c173039a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.888078 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-44d2b1ac-aefd-4e6b-9cf4-83f6c173039a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:54.896950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-44d2b1ac-aefd-4e6b-9cf4-83f6c173039a tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1289 microversion: 2.1 time: 0.093469 May 16 15:24:54.898009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 439/875] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:54 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:55.362584 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3dfbb66f-555c-44a8-9e3f-006ecacb5f48 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91908bb4-81e6-4256-b936-d830c17d0b94"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:55.363771 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3dfbb66f-555c-44a8-9e3f-006ecacb5f48 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:55.370311 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3dfbb66f-555c-44a8-9e3f-006ecacb5f48 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.370756 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3dfbb66f-555c-44a8-9e3f-006ecacb5f48 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.371520 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3dfbb66f-555c-44a8-9e3f-006ecacb5f48 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.371975 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3dfbb66f-555c-44a8-9e3f-006ecacb5f48 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.914489 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cdd873e6-64d6-47e2-9aae-a0dc6194aa9f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:55.915196 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cdd873e6-64d6-47e2-9aae-a0dc6194aa9f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:55.921259 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cdd873e6-64d6-47e2-9aae-a0dc6194aa9f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.921708 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cdd873e6-64d6-47e2-9aae-a0dc6194aa9f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.922483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cdd873e6-64d6-47e2-9aae-a0dc6194aa9f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.922914 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cdd873e6-64d6-47e2-9aae-a0dc6194aa9f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.029581 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3dfbb66f-555c-44a8-9e3f-006ecacb5f48 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "POST /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671407 May 16 15:24:56.030408 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 437/876] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:24:55 2022] POST /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments => generated 194 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:56.123973 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-cdd873e6-64d6-47e2-9aae-a0dc6194aa9f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:56.131741 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cdd873e6-64d6-47e2-9aae-a0dc6194aa9f tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1319 microversion: 2.1 time: 0.221029 May 16 15:24:56.132309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 440/877] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:55 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:56.226037 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-2e4d705a-d712-4670-9f84-313da6d7abe6 req-d94e23fa-1a2f-4d96-8643-ea35b14af0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4628f8b-2c41-4b6a-9609-0a90d8f5426f", "tag": "7ccf1ea8-5ab9-4663-bda5-21370c2174df"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:56.236942 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-2e4d705a-d712-4670-9f84-313da6d7abe6 req-d94e23fa-1a2f-4d96-8643-ea35b14af0c6 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.237389 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-2e4d705a-d712-4670-9f84-313da6d7abe6 req-d94e23fa-1a2f-4d96-8643-ea35b14af0c6 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.249918 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-2e4d705a-d712-4670-9f84-313da6d7abe6 req-d94e23fa-1a2f-4d96-8643-ea35b14af0c6 service nova] Creating event network-changed:7ccf1ea8-5ab9-4663-bda5-21370c2174df for instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f on hv-cinder-84175 May 16 15:24:56.255701 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-2e4d705a-d712-4670-9f84-313da6d7abe6 req-d94e23fa-1a2f-4d96-8643-ea35b14af0c6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033524 May 16 15:24:56.256485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 438/878] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:57.149017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8c67031e-9487-4b50-b292-31db31269371 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:57.149640 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8c67031e-9487-4b50-b292-31db31269371 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:57.155918 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8c67031e-9487-4b50-b292-31db31269371 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.156370 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8c67031e-9487-4b50-b292-31db31269371 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.157141 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8c67031e-9487-4b50-b292-31db31269371 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.157583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8c67031e-9487-4b50-b292-31db31269371 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.280501 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8c67031e-9487-4b50-b292-31db31269371 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:57.288290 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8c67031e-9487-4b50-b292-31db31269371 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1319 microversion: 2.1 time: 0.143311 May 16 15:24:57.288929 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 441/879] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:57 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:58.305475 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f27c57e8-1b95-4ac3-80be-80fca8f32082 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:58.306170 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f27c57e8-1b95-4ac3-80be-80fca8f32082 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:58.312666 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f27c57e8-1b95-4ac3-80be-80fca8f32082 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:58.313110 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f27c57e8-1b95-4ac3-80be-80fca8f32082 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:58.314578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f27c57e8-1b95-4ac3-80be-80fca8f32082 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:58.315018 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f27c57e8-1b95-4ac3-80be-80fca8f32082 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:58.449849 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f27c57e8-1b95-4ac3-80be-80fca8f32082 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:58.457624 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f27c57e8-1b95-4ac3-80be-80fca8f32082 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1319 microversion: 2.1 time: 0.156319 May 16 15:24:58.458187 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 439/880] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:58 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:59.474797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-83f20728-55e0-4cd6-bab5-f91f209ea0b2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:59.475546 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-83f20728-55e0-4cd6-bab5-f91f209ea0b2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:59.481819 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83f20728-55e0-4cd6-bab5-f91f209ea0b2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:59.482274 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83f20728-55e0-4cd6-bab5-f91f209ea0b2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:59.483046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83f20728-55e0-4cd6-bab5-f91f209ea0b2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:59.483484 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-83f20728-55e0-4cd6-bab5-f91f209ea0b2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:59.611031 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-83f20728-55e0-4cd6-bab5-f91f209ea0b2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:59.618393 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-83f20728-55e0-4cd6-bab5-f91f209ea0b2 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1319 microversion: 2.1 time: 0.147684 May 16 15:24:59.619736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 442/881] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:24:59 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:00.635775 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7f5a7bc0-bbed-4a84-b2e6-5441a22bd19c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:00.636390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7f5a7bc0-bbed-4a84-b2e6-5441a22bd19c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:00.642650 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f5a7bc0-bbed-4a84-b2e6-5441a22bd19c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:00.643094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f5a7bc0-bbed-4a84-b2e6-5441a22bd19c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.644046 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f5a7bc0-bbed-4a84-b2e6-5441a22bd19c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:00.644483 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7f5a7bc0-bbed-4a84-b2e6-5441a22bd19c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.771964 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7f5a7bc0-bbed-4a84-b2e6-5441a22bd19c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:00.779182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7f5a7bc0-bbed-4a84-b2e6-5441a22bd19c tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1319 microversion: 2.1 time: 0.147328 May 16 15:25:00.779771 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 440/882] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:00 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:01.796531 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-06d61364-387a-4cd7-a1a4-5e6de89bc140 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:01.797156 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-06d61364-387a-4cd7-a1a4-5e6de89bc140 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:01.803837 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-06d61364-387a-4cd7-a1a4-5e6de89bc140 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.804293 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-06d61364-387a-4cd7-a1a4-5e6de89bc140 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.805063 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-06d61364-387a-4cd7-a1a4-5e6de89bc140 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.805505 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-06d61364-387a-4cd7-a1a4-5e6de89bc140 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.931299 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-06d61364-387a-4cd7-a1a4-5e6de89bc140 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:01.938583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-06d61364-387a-4cd7-a1a4-5e6de89bc140 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1319 microversion: 2.1 time: 0.146049 May 16 15:25:01.939152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 443/883] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:01 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:02.297578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-294c7b13-c0f4-4133-b440-7a729b817f05 req-9cd8e273-ed9a-4fe5-b8ae-70b815959a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4628f8b-2c41-4b6a-9609-0a90d8f5426f", "name": "network-vif-plugged", "status": "completed", "tag": "7ccf1ea8-5ab9-4663-bda5-21370c2174df"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:02.307188 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-294c7b13-c0f4-4133-b440-7a729b817f05 req-9cd8e273-ed9a-4fe5-b8ae-70b815959a87 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.307682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-294c7b13-c0f4-4133-b440-7a729b817f05 req-9cd8e273-ed9a-4fe5-b8ae-70b815959a87 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.319186 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-294c7b13-c0f4-4133-b440-7a729b817f05 req-9cd8e273-ed9a-4fe5-b8ae-70b815959a87 service nova] Creating event network-vif-plugged:7ccf1ea8-5ab9-4663-bda5-21370c2174df for instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f on hv-cinder-84175 May 16 15:25:02.323981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-294c7b13-c0f4-4133-b440-7a729b817f05 req-9cd8e273-ed9a-4fe5-b8ae-70b815959a87 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030739 May 16 15:25:02.324566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 441/884] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:02.955838 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-24fd2a96-fdc7-46a9-9074-66857f6ba7ee tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:02.956446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-24fd2a96-fdc7-46a9-9074-66857f6ba7ee tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:02.962726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-24fd2a96-fdc7-46a9-9074-66857f6ba7ee tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.963166 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-24fd2a96-fdc7-46a9-9074-66857f6ba7ee tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.963950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-24fd2a96-fdc7-46a9-9074-66857f6ba7ee tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.964377 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-24fd2a96-fdc7-46a9-9074-66857f6ba7ee tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.090980 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-24fd2a96-fdc7-46a9-9074-66857f6ba7ee tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:03.098780 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-24fd2a96-fdc7-46a9-9074-66857f6ba7ee tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1319 microversion: 2.1 time: 0.147355 May 16 15:25:03.099597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 444/885] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:02 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:03.563563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-65fd382c-0a70-4164-b85a-fe744eecb7f8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:03.564347 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-65fd382c-0a70-4164-b85a-fe744eecb7f8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:03.570375 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65fd382c-0a70-4164-b85a-fe744eecb7f8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.570818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65fd382c-0a70-4164-b85a-fe744eecb7f8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.571578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65fd382c-0a70-4164-b85a-fe744eecb7f8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.572039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-65fd382c-0a70-4164-b85a-fe744eecb7f8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.699346 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-65fd382c-0a70-4164-b85a-fe744eecb7f8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:03.708103 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-65fd382c-0a70-4164-b85a-fe744eecb7f8 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1594 microversion: 2.1 time: 0.149316 May 16 15:25:03.708671 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 442/886] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:03 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1594 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:04.115951 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3585330f-7551-49b9-933b-5bc8f3690864 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:04.116484 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3585330f-7551-49b9-933b-5bc8f3690864 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:04.122759 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3585330f-7551-49b9-933b-5bc8f3690864 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:04.123209 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3585330f-7551-49b9-933b-5bc8f3690864 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:04.124032 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3585330f-7551-49b9-933b-5bc8f3690864 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:04.126768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3585330f-7551-49b9-933b-5bc8f3690864 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:04.321409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3585330f-7551-49b9-933b-5bc8f3690864 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:04.328653 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3585330f-7551-49b9-933b-5bc8f3690864 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1319 microversion: 2.1 time: 0.216779 May 16 15:25:04.329438 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 445/887] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:04 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:05.344921 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a643f229-ce43-4f3b-9fb9-4e805ef6626d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:05.345542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a643f229-ce43-4f3b-9fb9-4e805ef6626d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:05.352591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a643f229-ce43-4f3b-9fb9-4e805ef6626d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.353041 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a643f229-ce43-4f3b-9fb9-4e805ef6626d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.353806 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a643f229-ce43-4f3b-9fb9-4e805ef6626d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.354240 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a643f229-ce43-4f3b-9fb9-4e805ef6626d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.570569 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a643f229-ce43-4f3b-9fb9-4e805ef6626d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:05.578109 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a643f229-ce43-4f3b-9fb9-4e805ef6626d tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1507 microversion: 2.1 time: 0.237000 May 16 15:25:05.578684 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 443/888] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:05 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:05.594873 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-298e3424-70d1-44c7-92d3-8855ae771225 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e8e06e8-7999-4502-b0c0-6fd5990a25d5", "device": "/dev/sdb"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:05.597289 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-298e3424-70d1-44c7-92d3-8855ae771225 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:05.603907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-298e3424-70d1-44c7-92d3-8855ae771225 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.604474 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-298e3424-70d1-44c7-92d3-8855ae771225 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.605344 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-298e3424-70d1-44c7-92d3-8855ae771225 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.605843 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-298e3424-70d1-44c7-92d3-8855ae771225 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.104263 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-b164f52c-ab95-4ce9-9e8b-ae6c7dd95c0e req-96a2b197-89ca-4dcb-a684-fa0a4c997fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049aa153-31aa-449b-86ad-d9e47d70e18b", "tag": "26abdd01-015f-4c88-b71f-2308c1053124"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:06.113062 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-b164f52c-ab95-4ce9-9e8b-ae6c7dd95c0e req-96a2b197-89ca-4dcb-a684-fa0a4c997fc1 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:06.118191 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-b164f52c-ab95-4ce9-9e8b-ae6c7dd95c0e req-96a2b197-89ca-4dcb-a684-fa0a4c997fc1 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.125589 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-b164f52c-ab95-4ce9-9e8b-ae6c7dd95c0e req-96a2b197-89ca-4dcb-a684-fa0a4c997fc1 service nova] Creating event network-changed:26abdd01-015f-4c88-b71f-2308c1053124 for instance 049aa153-31aa-449b-86ad-d9e47d70e18b on hv-cinder-84175 May 16 15:25:06.130732 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-b164f52c-ab95-4ce9-9e8b-ae6c7dd95c0e req-96a2b197-89ca-4dcb-a684-fa0a4c997fc1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030021 May 16 15:25:06.131364 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 444/889] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:06.409870 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-298e3424-70d1-44c7-92d3-8855ae771225 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "POST /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818439 May 16 15:25:06.410502 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 446/890] 10.222.0.71 () {60 vars in 1322 bytes} [Mon May 16 15:25:05 2022] POST /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:09.058178 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3e7c0a43-a4af-4e01-8f61-8c314ab7bd4c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1059232174"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:09.058801 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3e7c0a43-a4af-4e01-8f61-8c314ab7bd4c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:09.065211 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3e7c0a43-a4af-4e01-8f61-8c314ab7bd4c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.066267 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3e7c0a43-a4af-4e01-8f61-8c314ab7bd4c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.067158 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3e7c0a43-a4af-4e01-8f61-8c314ab7bd4c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.067654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3e7c0a43-a4af-4e01-8f61-8c314ab7bd4c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.194875 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.network.security_group_api [None req-3e7c0a43-a4af-4e01-8f61-8c314ab7bd4c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Adding security group 7efe356f-9729-4a0d-8413-b57f51394870 to port 26abdd01-015f-4c88-b71f-2308c1053124 May 16 15:25:09.611213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3e7c0a43-a4af-4e01-8f61-8c314ab7bd4c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "POST /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/action" status: 202 len: 0 microversion: 2.1 time: 0.557790 May 16 15:25:09.611872 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 445/891] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:25:09 2022] POST /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:25:09.625029 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d1b82dbe-c141-44c3-9598-a4407b01162a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:09.625751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d1b82dbe-c141-44c3-9598-a4407b01162a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:09.630334 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-436ada70-18eb-429e-82b5-ddaac178afd1 req-0d5e7d57-e690-4017-8266-b17daef4b8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049aa153-31aa-449b-86ad-d9e47d70e18b", "tag": "26abdd01-015f-4c88-b71f-2308c1053124"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:09.640478 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-436ada70-18eb-429e-82b5-ddaac178afd1 req-0d5e7d57-e690-4017-8266-b17daef4b8ab service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.641919 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d1b82dbe-c141-44c3-9598-a4407b01162a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.642709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d1b82dbe-c141-44c3-9598-a4407b01162a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.643147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d1b82dbe-c141-44c3-9598-a4407b01162a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.643579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d1b82dbe-c141-44c3-9598-a4407b01162a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.645043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-436ada70-18eb-429e-82b5-ddaac178afd1 req-0d5e7d57-e690-4017-8266-b17daef4b8ab service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.660402 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-436ada70-18eb-429e-82b5-ddaac178afd1 req-0d5e7d57-e690-4017-8266-b17daef4b8ab service nova] Creating event network-changed:26abdd01-015f-4c88-b71f-2308c1053124 for instance 049aa153-31aa-449b-86ad-d9e47d70e18b on hv-cinder-84175 May 16 15:25:09.670564 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-436ada70-18eb-429e-82b5-ddaac178afd1 req-0d5e7d57-e690-4017-8266-b17daef4b8ab service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047696 May 16 15:25:09.671691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 446/892] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:09.920378 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d1b82dbe-c141-44c3-9598-a4407b01162a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:09.929560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d1b82dbe-c141-44c3-9598-a4407b01162a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1759 microversion: 2.1 time: 0.311322 May 16 15:25:09.930134 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 447/893] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:09 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1759 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:27.418139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d0c72df7-3bac-4976-9328-4e31ca41add6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:27.418713 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d0c72df7-3bac-4976-9328-4e31ca41add6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:27.424826 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d0c72df7-3bac-4976-9328-4e31ca41add6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:27.425535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d0c72df7-3bac-4976-9328-4e31ca41add6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:27.426309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d0c72df7-3bac-4976-9328-4e31ca41add6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:27.426746 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d0c72df7-3bac-4976-9328-4e31ca41add6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:27.654807 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-d0c72df7-3bac-4976-9328-4e31ca41add6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lazy-loading 'services' on Instance uuid f4628f8b-2c41-4b6a-9609-0a90d8f5426f {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:25:27.855223 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d0c72df7-3bac-4976-9328-4e31ca41add6 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "DELETE /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f/os-volume_attachments/9e8e06e8-7999-4502-b0c0-6fd5990a25d5" status: 202 len: 0 microversion: 2.1 time: 0.441730 May 16 15:25:27.855855 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 447/894] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:25:27 2022] DELETE /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f/os-volume_attachments/9e8e06e8-7999-4502-b0c0-6fd5990a25d5 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:25:28.962338 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-13b5b802-d2f6-41ba-b07a-73d031217af4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:28.962835 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-13b5b802-d2f6-41ba-b07a-73d031217af4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:28.969318 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-13b5b802-d2f6-41ba-b07a-73d031217af4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:28.969770 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-13b5b802-d2f6-41ba-b07a-73d031217af4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:28.970546 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-13b5b802-d2f6-41ba-b07a-73d031217af4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:28.971014 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-13b5b802-d2f6-41ba-b07a-73d031217af4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:28.997656 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-13b5b802-d2f6-41ba-b07a-73d031217af4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:25:29.304382 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-13b5b802-d2f6-41ba-b07a-73d031217af4 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "DELETE /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 204 len: 0 microversion: 2.1 time: 0.345619 May 16 15:25:29.304968 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 448/895] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:25:28 2022] DELETE /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:25:29.314310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b7d0b2cb-2820-4a2b-a56e-fd992b25e79b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:29.316338 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b7d0b2cb-2820-4a2b-a56e-fd992b25e79b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:29.323036 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b7d0b2cb-2820-4a2b-a56e-fd992b25e79b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.331654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b7d0b2cb-2820-4a2b-a56e-fd992b25e79b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.331654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b7d0b2cb-2820-4a2b-a56e-fd992b25e79b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.331654 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b7d0b2cb-2820-4a2b-a56e-fd992b25e79b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.450627 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b7d0b2cb-2820-4a2b-a56e-fd992b25e79b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:29.458004 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b7d0b2cb-2820-4a2b-a56e-fd992b25e79b tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1513 microversion: 2.1 time: 0.148360 May 16 15:25:29.458563 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 448/896] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:29 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:30.474925 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1021efb4-33f0-4e5b-b587-a26cc6b8f916 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:30.475673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1021efb4-33f0-4e5b-b587-a26cc6b8f916 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:30.481986 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1021efb4-33f0-4e5b-b587-a26cc6b8f916 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.482433 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1021efb4-33f0-4e5b-b587-a26cc6b8f916 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.483200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1021efb4-33f0-4e5b-b587-a26cc6b8f916 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.483649 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1021efb4-33f0-4e5b-b587-a26cc6b8f916 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.663137 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1021efb4-33f0-4e5b-b587-a26cc6b8f916 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:30.670437 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1021efb4-33f0-4e5b-b587-a26cc6b8f916 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1513 microversion: 2.1 time: 0.199847 May 16 15:25:30.671013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 449/897] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:30 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:31.688126 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3183ceff-f41f-44fd-b51d-930e3f016c16 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:31.689249 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3183ceff-f41f-44fd-b51d-930e3f016c16 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:31.697535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3183ceff-f41f-44fd-b51d-930e3f016c16 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.697991 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3183ceff-f41f-44fd-b51d-930e3f016c16 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.698779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3183ceff-f41f-44fd-b51d-930e3f016c16 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.699216 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3183ceff-f41f-44fd-b51d-930e3f016c16 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.747136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-0903d6ff-f516-4a31-9962-a20a9361a295 req-e699b63e-a378-43b2-b609-f28ea531ec10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4628f8b-2c41-4b6a-9609-0a90d8f5426f", "name": "network-vif-deleted", "tag": "7ccf1ea8-5ab9-4663-bda5-21370c2174df"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:31.756822 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-0903d6ff-f516-4a31-9962-a20a9361a295 req-e699b63e-a378-43b2-b609-f28ea531ec10 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.758326 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-0903d6ff-f516-4a31-9962-a20a9361a295 req-e699b63e-a378-43b2-b609-f28ea531ec10 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.768710 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-0903d6ff-f516-4a31-9962-a20a9361a295 req-e699b63e-a378-43b2-b609-f28ea531ec10 service nova] Creating event network-vif-deleted:7ccf1ea8-5ab9-4663-bda5-21370c2174df for instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f on hv-cinder-84175 May 16 15:25:31.774089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-0903d6ff-f516-4a31-9962-a20a9361a295 req-e699b63e-a378-43b2-b609-f28ea531ec10 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030878 May 16 15:25:31.774496 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3183ceff-f41f-44fd-b51d-930e3f016c16 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:31.774670 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 450/898] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:31.782296 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3183ceff-f41f-44fd-b51d-930e3f016c16 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1471 microversion: 2.1 time: 0.097936 May 16 15:25:31.787046 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 449/899] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:31 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1471 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:32.415053 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f58f5b69-e9d2-4f0c-b3c1-d25f34d5b8ea tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:32.416111 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f58f5b69-e9d2-4f0c-b3c1-d25f34d5b8ea tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:32.422341 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f58f5b69-e9d2-4f0c-b3c1-d25f34d5b8ea tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.422793 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f58f5b69-e9d2-4f0c-b3c1-d25f34d5b8ea tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.423560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f58f5b69-e9d2-4f0c-b3c1-d25f34d5b8ea tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.424021 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f58f5b69-e9d2-4f0c-b3c1-d25f34d5b8ea tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.694652 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f58f5b69-e9d2-4f0c-b3c1-d25f34d5b8ea tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "POST /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/action" status: 202 len: 0 microversion: 2.1 time: 0.283559 May 16 15:25:32.695293 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 451/900] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:25:32 2022] POST /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:25:32.703204 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-f390da9f-6169-4988-ac70-c5a729c98635 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:32.704723 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-f390da9f-6169-4988-ac70-c5a729c98635 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:32.711955 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f390da9f-6169-4988-ac70-c5a729c98635 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.712397 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f390da9f-6169-4988-ac70-c5a729c98635 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.713164 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f390da9f-6169-4988-ac70-c5a729c98635 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.713591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-f390da9f-6169-4988-ac70-c5a729c98635 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.799559 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:32.800282 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:32.807997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.808706 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.809686 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.810321 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.845030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.845735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.846189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lazy-loading 'fault' on Instance uuid f4628f8b-2c41-4b6a-9609-0a90d8f5426f {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:25:32.863842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-f390da9f-6169-4988-ac70-c5a729c98635 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:32.871892 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-f390da9f-6169-4988-ac70-c5a729c98635 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1751 microversion: 2.1 time: 0.172351 May 16 15:25:32.872467 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 450/901] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:32 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:32.918109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37b3b7824b24b328138061ae7af38f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e343d0e69de4a2c956a7ebc9056b8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:32.924722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b3b9d42b-f697-4d4c-8718-dd5eeb6264f0 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 200 len: 1309 microversion: 2.1 time: 0.130093 May 16 15:25:32.925293 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 452/902] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:32 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:33.890438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e8540c1c-d693-4cf5-8e0e-78b91dfebb94 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:33.891069 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e8540c1c-d693-4cf5-8e0e-78b91dfebb94 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:33.898192 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e8540c1c-d693-4cf5-8e0e-78b91dfebb94 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.901402 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e8540c1c-d693-4cf5-8e0e-78b91dfebb94 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.901402 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e8540c1c-d693-4cf5-8e0e-78b91dfebb94 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.901402 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e8540c1c-d693-4cf5-8e0e-78b91dfebb94 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.942599 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:33.943260 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] [instance: f4628f8b-2c41-4b6a-9609-0a90d8f5426f] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:33.949728 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.950186 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.950969 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.951407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.965409 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] HTTP exception thrown: Instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f could not be found. May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Request method failure captured: May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f HTTP/1.1 May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmxiIRUsI_avqvqIXOdBLGvgs_UzpLVMaSrxIqLcTERhpnv7YZBRAMjbsXYI8-lECImt5lsDSsMur7RJ0ZZydfe6pSwCuVA9TcreU-qAxbvLCsUI-zOKnQYZTLpYNP6JiW1NfzsWsz1pYeh1dTHdzaMLgruD7mF_faNXQVTCEVXUS6s May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 5e343d0e69de4a2c956a7ebc9056b8d5 May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1260477555 May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:25:33.967050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e343d0e69de4a2c956a7ebc9056b8d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5e343d0e69de4a2c956a7ebc9056b8d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5e343d0e69de4a2c956a7ebc9056b8d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e343d0e69de4a2c956a7ebc9056b8d5"}]}] May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-VolumesSnapshotTestJSON-1260477555 May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 5e343d0e69de4a2c956a7ebc9056b8d5 May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1260477555 May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-VolumesSnapshotTestJSON-1260477555-project May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: d37b3b7824b24b328138061ae7af38f8 May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-VolumesSnapshotTestJSON-1260477555-project May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f could not be found. May 16 15:25:33.968768 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'f4628f8b-2c41-4b6a-9609-0a90d8f5426f'} May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f could not be found. May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:25:33.969671 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f could not be found. May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f could not be found. May 16 15:25:33.971087 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:25:33.972383 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] Returning 404 to user: Instance f4628f8b-2c41-4b6a-9609-0a90d8f5426f could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:25:33.972383 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-84ec75ea-bd5a-4ecf-a744-992f4ae93c88 tempest-VolumesSnapshotTestJSON-1260477555 tempest-VolumesSnapshotTestJSON-1260477555-project] 10.222.0.71 "GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f" status: 404 len: 111 microversion: 2.1 time: 0.030232 May 16 15:25:33.972383 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 453/903] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:33 2022] GET /compute/v2.1/servers/f4628f8b-2c41-4b6a-9609-0a90d8f5426f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:25:34.048149 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e8540c1c-d693-4cf5-8e0e-78b91dfebb94 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:34.056335 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e8540c1c-d693-4cf5-8e0e-78b91dfebb94 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.169898 May 16 15:25:34.056905 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 451/904] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:33 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:35.073659 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fbed1bdd-8a5c-4db4-a45d-a00428a9bf6b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:35.074280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fbed1bdd-8a5c-4db4-a45d-a00428a9bf6b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:35.080537 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fbed1bdd-8a5c-4db4-a45d-a00428a9bf6b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.080980 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fbed1bdd-8a5c-4db4-a45d-a00428a9bf6b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:35.081734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fbed1bdd-8a5c-4db4-a45d-a00428a9bf6b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.082164 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fbed1bdd-8a5c-4db4-a45d-a00428a9bf6b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:35.221180 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-fbed1bdd-8a5c-4db4-a45d-a00428a9bf6b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:35.229707 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-fbed1bdd-8a5c-4db4-a45d-a00428a9bf6b tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.159835 May 16 15:25:35.230265 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 454/905] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:35 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:36.254699 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5e189bcd-1958-4925-b641-d5ea3f2583a2 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:36.255320 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5e189bcd-1958-4925-b641-d5ea3f2583a2 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:36.262315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e189bcd-1958-4925-b641-d5ea3f2583a2 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:36.262772 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e189bcd-1958-4925-b641-d5ea3f2583a2 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:36.263733 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e189bcd-1958-4925-b641-d5ea3f2583a2 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:36.264214 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5e189bcd-1958-4925-b641-d5ea3f2583a2 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:36.405014 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5e189bcd-1958-4925-b641-d5ea3f2583a2 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:36.413107 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5e189bcd-1958-4925-b641-d5ea3f2583a2 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.162416 May 16 15:25:36.413670 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 452/906] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:36 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:37.430658 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d9b6bf90-5aff-4947-b501-404ea3bce704 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:37.431272 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d9b6bf90-5aff-4947-b501-404ea3bce704 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:37.437581 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d9b6bf90-5aff-4947-b501-404ea3bce704 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.438025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d9b6bf90-5aff-4947-b501-404ea3bce704 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.438788 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d9b6bf90-5aff-4947-b501-404ea3bce704 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.439214 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d9b6bf90-5aff-4947-b501-404ea3bce704 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.575895 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d9b6bf90-5aff-4947-b501-404ea3bce704 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:37.583553 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d9b6bf90-5aff-4947-b501-404ea3bce704 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.157242 May 16 15:25:37.584136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 455/907] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:37 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:38.600908 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a5699343-e63b-4177-ad6b-231f44c8bd0e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:38.601656 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a5699343-e63b-4177-ad6b-231f44c8bd0e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:38.608024 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a5699343-e63b-4177-ad6b-231f44c8bd0e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:38.608468 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a5699343-e63b-4177-ad6b-231f44c8bd0e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:38.609231 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a5699343-e63b-4177-ad6b-231f44c8bd0e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:38.609660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a5699343-e63b-4177-ad6b-231f44c8bd0e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:38.746662 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-a5699343-e63b-4177-ad6b-231f44c8bd0e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:38.754541 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a5699343-e63b-4177-ad6b-231f44c8bd0e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.157821 May 16 15:25:38.755137 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 453/908] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:38 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:39.773394 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-52fb4f05-1a75-407a-98ff-706aaf974a41 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:39.774003 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-52fb4f05-1a75-407a-98ff-706aaf974a41 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:39.780572 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52fb4f05-1a75-407a-98ff-706aaf974a41 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:39.781025 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52fb4f05-1a75-407a-98ff-706aaf974a41 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:39.781797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52fb4f05-1a75-407a-98ff-706aaf974a41 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:39.782232 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-52fb4f05-1a75-407a-98ff-706aaf974a41 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:39.926847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-52fb4f05-1a75-407a-98ff-706aaf974a41 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:39.934629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-52fb4f05-1a75-407a-98ff-706aaf974a41 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.166246 May 16 15:25:39.935189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 456/909] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:39 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:40.952476 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0e2cb3fe-7a7b-4a78-93ca-3ec68840cc40 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:40.953092 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0e2cb3fe-7a7b-4a78-93ca-3ec68840cc40 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:40.959307 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e2cb3fe-7a7b-4a78-93ca-3ec68840cc40 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.959789 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e2cb3fe-7a7b-4a78-93ca-3ec68840cc40 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.960551 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e2cb3fe-7a7b-4a78-93ca-3ec68840cc40 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.961645 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0e2cb3fe-7a7b-4a78-93ca-3ec68840cc40 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:41.098691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0e2cb3fe-7a7b-4a78-93ca-3ec68840cc40 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:41.106581 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0e2cb3fe-7a7b-4a78-93ca-3ec68840cc40 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.158082 May 16 15:25:41.107145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 454/910] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:40 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:42.123677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-bf30ac41-e66a-4ad4-acc6-903bc18a948c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:42.124298 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-bf30ac41-e66a-4ad4-acc6-903bc18a948c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:42.130608 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bf30ac41-e66a-4ad4-acc6-903bc18a948c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.131058 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bf30ac41-e66a-4ad4-acc6-903bc18a948c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.131860 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bf30ac41-e66a-4ad4-acc6-903bc18a948c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.132323 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-bf30ac41-e66a-4ad4-acc6-903bc18a948c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.278150 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-bf30ac41-e66a-4ad4-acc6-903bc18a948c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:42.285989 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-bf30ac41-e66a-4ad4-acc6-903bc18a948c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.166150 May 16 15:25:42.286550 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 457/911] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:42 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:43.303465 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-47beaba6-15fd-4af0-b278-bde618d330fc tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:43.304113 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-47beaba6-15fd-4af0-b278-bde618d330fc tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:43.311578 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-47beaba6-15fd-4af0-b278-bde618d330fc tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.312057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-47beaba6-15fd-4af0-b278-bde618d330fc tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.312826 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-47beaba6-15fd-4af0-b278-bde618d330fc tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.313270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-47beaba6-15fd-4af0-b278-bde618d330fc tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.462144 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-47beaba6-15fd-4af0-b278-bde618d330fc tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:43.467367 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-47beaba6-15fd-4af0-b278-bde618d330fc tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.167612 May 16 15:25:43.468304 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 455/912] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:43 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:44.484688 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7d32f6f6-02e2-4adc-aa2a-6d4b94dda7c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:44.485303 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7d32f6f6-02e2-4adc-aa2a-6d4b94dda7c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:44.491551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7d32f6f6-02e2-4adc-aa2a-6d4b94dda7c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:44.492022 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7d32f6f6-02e2-4adc-aa2a-6d4b94dda7c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:44.493564 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7d32f6f6-02e2-4adc-aa2a-6d4b94dda7c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:44.493996 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7d32f6f6-02e2-4adc-aa2a-6d4b94dda7c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:44.648782 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7d32f6f6-02e2-4adc-aa2a-6d4b94dda7c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:44.656747 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7d32f6f6-02e2-4adc-aa2a-6d4b94dda7c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1756 microversion: 2.1 time: 0.175828 May 16 15:25:44.657316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 458/913] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:44 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:45.674714 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8394adf9-3ee0-4ec3-8f8e-ed8858a8a49e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:45.675332 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8394adf9-3ee0-4ec3-8f8e-ed8858a8a49e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:45.682677 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8394adf9-3ee0-4ec3-8f8e-ed8858a8a49e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.683129 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8394adf9-3ee0-4ec3-8f8e-ed8858a8a49e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.683952 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8394adf9-3ee0-4ec3-8f8e-ed8858a8a49e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.684371 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8394adf9-3ee0-4ec3-8f8e-ed8858a8a49e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.822310 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-8394adf9-3ee0-4ec3-8f8e-ed8858a8a49e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:45.830039 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8394adf9-3ee0-4ec3-8f8e-ed8858a8a49e tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1759 microversion: 2.1 time: 0.159175 May 16 15:25:45.830611 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 456/914] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:25:45 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1759 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:12.978506 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-306662a6-c55d-4e1e-ab2b-f8df7c45a163 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Action: 'create', calling method: .version_select at 0x7f0c836ef4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1366159048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoZkJ8lktc+YjbaEtqYG8HGR7QCLW9+cOZtDwIah5MaXswDdwdDZpvWOtuakUJyVgRz/Yxq7y651nKAuksS2KZ59d0/kYjDdJIzHjfhG891n85QIa4YMyhna5rqDaWmzQ=="}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:12.996407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-306662a6-c55d-4e1e-ab2b-f8df7c45a163 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Getting quotas for project 5cef808bf8324f5b852fd0ea7f368f6d. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:26:13.000500 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-306662a6-c55d-4e1e-ab2b-f8df7c45a163 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Getting quotas for user 3715d415c2e24297a30a4c948c2677ef and project 5cef808bf8324f5b852fd0ea7f368f6d. Resources: {'key_pairs'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:26:13.013219 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR oslo.messaging._drivers.impl_rabbit [None req-306662a6-c55d-4e1e-ab2b-f8df7c45a163 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [1b5ddbef-0e12-47c0-bbdd-8cc4a1800040] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 15:26:14.020394 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [None req-306662a6-c55d-4e1e-ab2b-f8df7c45a163 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [1b5ddbef-0e12-47c0-bbdd-8cc4a1800040] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 34070. May 16 15:26:14.084831 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-306662a6-c55d-4e1e-ab2b-f8df7c45a163 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.297254 May 16 15:26:14.085427 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 459/915] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:26:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:18.466143 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-55fffb63-ff98-4208-88ae-5672d1494f6c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1059232174"}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:18.466791 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-55fffb63-ff98-4208-88ae-5672d1494f6c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:18.472715 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55fffb63-ff98-4208-88ae-5672d1494f6c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:18.473171 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55fffb63-ff98-4208-88ae-5672d1494f6c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:18.473941 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55fffb63-ff98-4208-88ae-5672d1494f6c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:18.474380 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-55fffb63-ff98-4208-88ae-5672d1494f6c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:18.598597 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.network.security_group_api [None req-55fffb63-ff98-4208-88ae-5672d1494f6c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Removing security group 7efe356f-9729-4a0d-8413-b57f51394870 from port 26abdd01-015f-4c88-b71f-2308c1053124 May 16 15:26:19.028312 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-55fffb63-ff98-4208-88ae-5672d1494f6c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "POST /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/action" status: 202 len: 0 microversion: 2.1 time: 0.566139 May 16 15:26:19.033301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 457/916] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:26:18 2022] POST /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:26:19.042961 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-02194911-2f96-4c03-9695-309fbd66525f req-2d79e423-785c-47e6-bc63-031b7f9601f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049aa153-31aa-449b-86ad-d9e47d70e18b", "tag": "26abdd01-015f-4c88-b71f-2308c1053124"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:19.066088 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-02194911-2f96-4c03-9695-309fbd66525f req-2d79e423-785c-47e6-bc63-031b7f9601f1 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:19.069908 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-02194911-2f96-4c03-9695-309fbd66525f req-2d79e423-785c-47e6-bc63-031b7f9601f1 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:19.090931 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-02194911-2f96-4c03-9695-309fbd66525f req-2d79e423-785c-47e6-bc63-031b7f9601f1 service nova] Creating event network-changed:26abdd01-015f-4c88-b71f-2308c1053124 for instance 049aa153-31aa-449b-86ad-d9e47d70e18b on hv-cinder-84175 May 16 15:26:19.105583 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-02194911-2f96-4c03-9695-309fbd66525f req-2d79e423-785c-47e6-bc63-031b7f9601f1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066814 May 16 15:26:19.111346 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 460/917] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:20.480536 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5a0cf5ef-3a60-45fd-a895-c03c6b4d9c25 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:20.481685 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5a0cf5ef-3a60-45fd-a895-c03c6b4d9c25 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:20.488807 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a0cf5ef-3a60-45fd-a895-c03c6b4d9c25 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.489330 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a0cf5ef-3a60-45fd-a895-c03c6b4d9c25 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.490237 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a0cf5ef-3a60-45fd-a895-c03c6b4d9c25 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.490741 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a0cf5ef-3a60-45fd-a895-c03c6b4d9c25 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.547921 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-e31b14cf-8ed7-401e-bc77-8646edfcd5e9 req-496cb84d-20af-4986-b01c-ff58e08daa9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049aa153-31aa-449b-86ad-d9e47d70e18b", "tag": "26abdd01-015f-4c88-b71f-2308c1053124"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:20.557655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-e31b14cf-8ed7-401e-bc77-8646edfcd5e9 req-496cb84d-20af-4986-b01c-ff58e08daa9f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.558314 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-e31b14cf-8ed7-401e-bc77-8646edfcd5e9 req-496cb84d-20af-4986-b01c-ff58e08daa9f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.569228 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-e31b14cf-8ed7-401e-bc77-8646edfcd5e9 req-496cb84d-20af-4986-b01c-ff58e08daa9f service nova] Creating event network-changed:26abdd01-015f-4c88-b71f-2308c1053124 for instance 049aa153-31aa-449b-86ad-d9e47d70e18b on hv-cinder-84175 May 16 15:26:20.574613 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-e31b14cf-8ed7-401e-bc77-8646edfcd5e9 req-496cb84d-20af-4986-b01c-ff58e08daa9f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095747 May 16 15:26:20.575449 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 461/918] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:26:20.579862 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-5a0cf5ef-3a60-45fd-a895-c03c6b4d9c25 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lazy-loading 'services' on Instance uuid 049aa153-31aa-449b-86ad-d9e47d70e18b {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:20.778618 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5a0cf5ef-3a60-45fd-a895-c03c6b4d9c25 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "DELETE /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments/91908bb4-81e6-4256-b936-d830c17d0b94" status: 202 len: 0 microversion: 2.1 time: 0.302768 May 16 15:26:20.779224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 458/919] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:26:20 2022] DELETE /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments/91908bb4-81e6-4256-b936-d830c17d0b94 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:26:20.794984 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2b75bbf1-c671-4bda-bb77-04487804f3c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:20.796381 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2b75bbf1-c671-4bda-bb77-04487804f3c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:20.806741 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2b75bbf1-c671-4bda-bb77-04487804f3c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.807192 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2b75bbf1-c671-4bda-bb77-04487804f3c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.808002 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2b75bbf1-c671-4bda-bb77-04487804f3c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.808436 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2b75bbf1-c671-4bda-bb77-04487804f3c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.840668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2b75bbf1-c671-4bda-bb77-04487804f3c9 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056726 May 16 15:26:20.847791 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 462/920] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:26:20 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:21.856442 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-43a777cc-7322-465f-af58-85c65d17466a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:21.857518 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-43a777cc-7322-465f-af58-85c65d17466a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:21.864505 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-43a777cc-7322-465f-af58-85c65d17466a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:21.866929 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-43a777cc-7322-465f-af58-85c65d17466a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:21.866929 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-43a777cc-7322-465f-af58-85c65d17466a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:21.866929 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-43a777cc-7322-465f-af58-85c65d17466a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:21.897803 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-43a777cc-7322-465f-af58-85c65d17466a tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046845 May 16 15:26:21.898372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 459/921] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:26:21 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:26:22.910543 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-9f6464cd-bac3-4056-9812-7fff7e02d152 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:22.911470 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-9f6464cd-bac3-4056-9812-7fff7e02d152 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:22.918849 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9f6464cd-bac3-4056-9812-7fff7e02d152 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.919313 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9f6464cd-bac3-4056-9812-7fff7e02d152 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.920142 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9f6464cd-bac3-4056-9812-7fff7e02d152 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.920681 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9f6464cd-bac3-4056-9812-7fff7e02d152 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.949729 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-9f6464cd-bac3-4056-9812-7fff7e02d152 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043230 May 16 15:26:22.950280 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 463/922] 10.222.0.71 () {58 vars in 1301 bytes} [Mon May 16 15:26:22 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:26:22.960631 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:22.961335 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:22.967802 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.968257 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.969021 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.969452 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:23.044407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] HTTP exception thrown: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b is not attached to volume 91908bb4-81e6-4256-b936-d830c17d0b94 May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Request method failure captured: May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: DELETE /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments/91908bb4-81e6-4256-b936-d830c17d0b94 HTTP/1.1 May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigmyZVQBts1qKgmIkd-MykY-3AV4MutJgfd4f0ioC41ZXDU-ySXHJ-e4r9DOuf4ueJduAezvBNP0D06LIkmOj0bEnJIYX00eCeMMAPV0bv5n0PyVyW8-cwnZNaurTEDvA_uCejViDfv1r-_hiK7bH8hR5arusANrnslJu2QMUpe96aO8 May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: ae0f47501cc04e37bec6bfc3cd696ea9 May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-TestMinimumBasicScenario-699787720 May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:26:23.046779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ae0f47501cc04e37bec6bfc3cd696ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ae0f47501cc04e37bec6bfc3cd696ea9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ae0f47501cc04e37bec6bfc3cd696ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ae0f47501cc04e37bec6bfc3cd696ea9"}]}] May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-TestMinimumBasicScenario-699787720 May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: ae0f47501cc04e37bec6bfc3cd696ea9 May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-TestMinimumBasicScenario-699787720 May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-TestMinimumBasicScenario-699787720-project May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 6cda1596ad5d4032827f9250a17f1235 May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-TestMinimumBasicScenario-699787720-project May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:26:23.048692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b is not attached to volume 91908bb4-81e6-4256-b936-d830c17d0b94 May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'server_id': '049aa153-31aa-449b-86ad-d9e47d70e18b', 'id': '91908bb4-81e6-4256-b936-d830c17d0b94'} May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 91908bb4-81e6-4256-b936-d830c17d0b94. May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:23.049911 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b is not attached to volume 91908bb4-81e6-4256-b936-d830c17d0b94 May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b is not attached to volume 91908bb4-81e6-4256-b936-d830c17d0b94 May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:26:23.051778 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Returning 404 to user: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b is not attached to volume 91908bb4-81e6-4256-b936-d830c17d0b94 {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:23.052946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a1fe038d-ef72-4f27-a902-6a9422ddb9d4 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "DELETE /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments/91908bb4-81e6-4256-b936-d830c17d0b94" status: 404 len: 154 microversion: 2.1 time: 0.091832 May 16 15:26:23.052946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 460/923] 10.222.0.71 () {58 vars in 1415 bytes} [Mon May 16 15:26:22 2022] DELETE /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b/os-volume_attachments/91908bb4-81e6-4256-b936-d830c17d0b94 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:26:24.318631 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8678ae17-5447-47b0-b8ab-b2d8bab966ff tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:24.319135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8678ae17-5447-47b0-b8ab-b2d8bab966ff tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:24.325561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8678ae17-5447-47b0-b8ab-b2d8bab966ff tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:24.326015 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8678ae17-5447-47b0-b8ab-b2d8bab966ff tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:24.326791 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8678ae17-5447-47b0-b8ab-b2d8bab966ff tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:24.327231 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8678ae17-5447-47b0-b8ab-b2d8bab966ff tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:24.354941 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8678ae17-5447-47b0-b8ab-b2d8bab966ff tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:26:24.652136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8678ae17-5447-47b0-b8ab-b2d8bab966ff tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "DELETE /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 204 len: 0 microversion: 2.1 time: 0.336997 May 16 15:26:24.652728 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 464/924] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:26:24 2022] DELETE /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:26:24.662020 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-89217d62-dcfb-4915-95d1-6bbd5dc71ab5 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:24.665679 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-89217d62-dcfb-4915-95d1-6bbd5dc71ab5 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:24.672841 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89217d62-dcfb-4915-95d1-6bbd5dc71ab5 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:24.673289 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89217d62-dcfb-4915-95d1-6bbd5dc71ab5 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:24.674059 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89217d62-dcfb-4915-95d1-6bbd5dc71ab5 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:24.674488 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89217d62-dcfb-4915-95d1-6bbd5dc71ab5 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:24.806300 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-89217d62-dcfb-4915-95d1-6bbd5dc71ab5 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:24.814072 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-89217d62-dcfb-4915-95d1-6bbd5dc71ab5 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1554 microversion: 2.1 time: 0.157024 May 16 15:26:24.814632 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 461/925] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:24 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:25.832980 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-5e38770b-a10a-41b2-9bfd-551e4da61bf3 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:25.833688 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-5e38770b-a10a-41b2-9bfd-551e4da61bf3 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:25.840082 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5e38770b-a10a-41b2-9bfd-551e4da61bf3 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:25.840535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5e38770b-a10a-41b2-9bfd-551e4da61bf3 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:25.841311 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5e38770b-a10a-41b2-9bfd-551e4da61bf3 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:25.841750 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-5e38770b-a10a-41b2-9bfd-551e4da61bf3 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:25.975488 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-5e38770b-a10a-41b2-9bfd-551e4da61bf3 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:25.983616 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-5e38770b-a10a-41b2-9bfd-551e4da61bf3 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1554 microversion: 2.1 time: 0.155568 May 16 15:26:25.984197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 465/926] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:25 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:27.004850 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8cb9a268-ecd2-4c73-bd48-e2c49f6b3904 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:27.005470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-8cb9a268-ecd2-4c73-bd48-e2c49f6b3904 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:27.012087 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8cb9a268-ecd2-4c73-bd48-e2c49f6b3904 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.012548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8cb9a268-ecd2-4c73-bd48-e2c49f6b3904 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.013455 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8cb9a268-ecd2-4c73-bd48-e2c49f6b3904 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.013898 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-8cb9a268-ecd2-4c73-bd48-e2c49f6b3904 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.167029 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-8cb9a268-ecd2-4c73-bd48-e2c49f6b3904 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:27.174865 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8cb9a268-ecd2-4c73-bd48-e2c49f6b3904 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1554 microversion: 2.1 time: 0.174503 May 16 15:26:27.175780 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 462/927] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:26 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:27.261595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-06da1a96-30fd-4797-8d7a-a1af5ed3e095 req-cbef8979-ab82-4cfb-8548-ba7bb0649fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049aa153-31aa-449b-86ad-d9e47d70e18b", "name": "network-vif-deleted", "tag": "26abdd01-015f-4c88-b71f-2308c1053124"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:27.270166 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-06da1a96-30fd-4797-8d7a-a1af5ed3e095 req-cbef8979-ab82-4cfb-8548-ba7bb0649fd3 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.270611 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-06da1a96-30fd-4797-8d7a-a1af5ed3e095 req-cbef8979-ab82-4cfb-8548-ba7bb0649fd3 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.282220 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-06da1a96-30fd-4797-8d7a-a1af5ed3e095 req-cbef8979-ab82-4cfb-8548-ba7bb0649fd3 service nova] Creating event network-vif-deleted:26abdd01-015f-4c88-b71f-2308c1053124 for instance 049aa153-31aa-449b-86ad-d9e47d70e18b on hv-cinder-84175 May 16 15:26:27.286937 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-06da1a96-30fd-4797-8d7a-a1af5ed3e095 req-cbef8979-ab82-4cfb-8548-ba7bb0649fd3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029808 May 16 15:26:27.287523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 466/928] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:28.192542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:28.193158 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:28.200147 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.200597 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:28.201362 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.201809 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:28.233012 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.233461 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:28.233914 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lazy-loading 'fault' on Instance uuid 049aa153-31aa-449b-86ad-d9e47d70e18b {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:28.275485 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cda1596ad5d4032827f9250a17f1235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f47501cc04e37bec6bfc3cd696ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:28.282574 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4a89bfb7-32bb-4ebf-bab6-df40d0931368 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 200 len: 1348 microversion: 2.1 time: 0.093978 May 16 15:26:28.283145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 463/929] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:28 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:29.301162 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:29.301855 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [instance: 049aa153-31aa-449b-86ad-d9e47d70e18b] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:29.307998 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:29.308446 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:29.309201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:29.309630 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:29.322503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] HTTP exception thrown: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b could not be found. May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Request method failure captured: May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b HTTP/1.1 May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigmyZVQBts1qKgmIkd-MykY-3AV4MutJgfd4f0ioC41ZXDU-ySXHJ-e4r9DOuf4ueJduAezvBNP0D06LIkmOj0bEnJIYX00eCeMMAPV0bv5n0PyVyW8-cwnZNaurTEDvA_uCejViDfv1r-_hiK7bH8hR5arusANrnslJu2QMUpe96aO8 May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: ae0f47501cc04e37bec6bfc3cd696ea9 May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-TestMinimumBasicScenario-699787720 May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:26:29.324146 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ae0f47501cc04e37bec6bfc3cd696ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ae0f47501cc04e37bec6bfc3cd696ea9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ae0f47501cc04e37bec6bfc3cd696ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ae0f47501cc04e37bec6bfc3cd696ea9"}]}] May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-TestMinimumBasicScenario-699787720 May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: ae0f47501cc04e37bec6bfc3cd696ea9 May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-TestMinimumBasicScenario-699787720 May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-TestMinimumBasicScenario-699787720-project May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 6cda1596ad5d4032827f9250a17f1235 May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-TestMinimumBasicScenario-699787720-project May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b could not be found. May 16 15:26:29.325722 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '049aa153-31aa-449b-86ad-d9e47d70e18b'} May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b could not be found. May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:29.326778 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b could not be found. May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b could not be found. May 16 15:26:29.328294 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:26:29.329841 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Returning 404 to user: Instance 049aa153-31aa-449b-86ad-d9e47d70e18b could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:29.329841 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-31638408-b847-4a53-ab10-f2c439b11eb6 tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b" status: 404 len: 111 microversion: 2.1 time: 0.028924 May 16 15:26:29.329841 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 467/930] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:29 2022] GET /compute/v2.1/servers/049aa153-31aa-449b-86ad-d9e47d70e18b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:26:29.333910 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-48622480-0524-4932-8d2c-963b3471364c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] Calling method '.version_select at 0x7f0c880bc940>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:29.337669 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR oslo.messaging._drivers.impl_rabbit [None req-48622480-0524-4932-8d2c-963b3471364c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [1225c048-11fa-43d0-9436-7c6549597682] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 15:26:30.345825 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [None req-48622480-0524-4932-8d2c-963b3471364c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] [1225c048-11fa-43d0-9436-7c6549597682] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 34234. May 16 15:26:30.435542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-48622480-0524-4932-8d2c-963b3471364c tempest-TestMinimumBasicScenario-699787720 tempest-TestMinimumBasicScenario-699787720-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-958374759" status: 202 len: 0 microversion: 2.1 time: 1.105233 May 16 15:26:30.436158 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 464/931] 10.222.0.71 () {58 vars in 1268 bytes} [Mon May 16 15:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-958374759 => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:26:33.027485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-47243245", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1366159048", "security_groups": [{"name": "tempest-secgroup-smoke-280464144"}], "networks": [{"uuid": "0b25748a-d962-474f-b758-5724d0298e7d"}], "block_device_mapping_v2": [{"uuid": "9ea2554a-cec3-4c78-bb76-df7386cd34c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:33.146677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] validate_networks() for [('0b25748a-d962-474f-b758-5724d0298e7d', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:26:33.553813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:26:33.554517 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:26:33.556516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:26:33.556928 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:26:33.560675 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:26:33.566617 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:33.567132 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:33.568077 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:33.568588 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:33.589815 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Getting quotas for project 5cef808bf8324f5b852fd0ea7f368f6d. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:26:33.596097 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Getting quotas for user 3715d415c2e24297a30a4c948c2677ef and project 5cef808bf8324f5b852fd0ea7f368f6d. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:26:33.656360 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:26:33.658434 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ea2554a-cec3-4c78-bb76-df7386cd34c5',volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:26:34.140468 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-cf5171fa-c6be-48c7-bf04-07767f896b5f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.117392 May 16 15:26:34.153531 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9027ba4b-d3cf-4f17-ac71-668d2b7fe370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:34.154751 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9027ba4b-d3cf-4f17-ac71-668d2b7fe370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:34.159188 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 468/932] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:26:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:26:34.229167 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9027ba4b-d3cf-4f17-ac71-668d2b7fe370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:34.237303 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9027ba4b-d3cf-4f17-ac71-668d2b7fe370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1087 microversion: 2.1 time: 0.088150 May 16 15:26:34.237875 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 465/933] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:34 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1087 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:35.254788 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3689b402-5322-41d0-9a9c-bff63e9fe4ee tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:35.255443 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3689b402-5322-41d0-9a9c-bff63e9fe4ee tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:35.309688 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3689b402-5322-41d0-9a9c-bff63e9fe4ee tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:35.316485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3689b402-5322-41d0-9a9c-bff63e9fe4ee tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1087 microversion: 2.1 time: 0.066039 May 16 15:26:35.317052 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 469/934] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:35 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1087 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:36.333709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-105ac039-4513-4c58-b817-281f7590cda0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:36.334324 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-105ac039-4513-4c58-b817-281f7590cda0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:36.342082 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-105ac039-4513-4c58-b817-281f7590cda0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:36.342619 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-105ac039-4513-4c58-b817-281f7590cda0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:36.343472 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-105ac039-4513-4c58-b817-281f7590cda0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:36.344011 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-105ac039-4513-4c58-b817-281f7590cda0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:36.430487 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-105ac039-4513-4c58-b817-281f7590cda0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:36.439877 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-105ac039-4513-4c58-b817-281f7590cda0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1193 microversion: 2.1 time: 0.109824 May 16 15:26:36.440816 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 466/935] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:36 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:37.459307 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0e244f0f-c9f2-42eb-b047-811fd8fc3059 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:37.460912 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0e244f0f-c9f2-42eb-b047-811fd8fc3059 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:37.469237 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e244f0f-c9f2-42eb-b047-811fd8fc3059 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:37.469918 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e244f0f-c9f2-42eb-b047-811fd8fc3059 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:37.470863 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e244f0f-c9f2-42eb-b047-811fd8fc3059 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:37.471460 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0e244f0f-c9f2-42eb-b047-811fd8fc3059 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:37.689064 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0e244f0f-c9f2-42eb-b047-811fd8fc3059 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:37.697469 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0e244f0f-c9f2-42eb-b047-811fd8fc3059 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1270 microversion: 2.1 time: 0.243935 May 16 15:26:37.698061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 470/936] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:37 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:38.656173 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-6cf9333c-ca32-4fa8-92b4-d8510e1df6d4 req-7a85cd05-8d48-4f8c-94dd-d1ecd18d1b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf88b0c-dcde-4971-add1-d08786fa819e", "tag": "adc3da56-eadd-4439-888a-efe0eb7ab5cf"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:38.663601 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-6cf9333c-ca32-4fa8-92b4-d8510e1df6d4 req-7a85cd05-8d48-4f8c-94dd-d1ecd18d1b43 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:38.664695 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-6cf9333c-ca32-4fa8-92b4-d8510e1df6d4 req-7a85cd05-8d48-4f8c-94dd-d1ecd18d1b43 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:38.677950 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-6cf9333c-ca32-4fa8-92b4-d8510e1df6d4 req-7a85cd05-8d48-4f8c-94dd-d1ecd18d1b43 service nova] Creating event network-changed:adc3da56-eadd-4439-888a-efe0eb7ab5cf for instance fdf88b0c-dcde-4971-add1-d08786fa819e on hv-cinder-84175 May 16 15:26:38.683612 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-6cf9333c-ca32-4fa8-92b4-d8510e1df6d4 req-7a85cd05-8d48-4f8c-94dd-d1ecd18d1b43 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102850 May 16 15:26:38.685147 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 467/937] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:38.715052 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8300456b-6394-44e4-98f9-a4c78cbabb8f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:38.715867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8300456b-6394-44e4-98f9-a4c78cbabb8f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:38.723732 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8300456b-6394-44e4-98f9-a4c78cbabb8f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:38.724516 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8300456b-6394-44e4-98f9-a4c78cbabb8f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:38.725802 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8300456b-6394-44e4-98f9-a4c78cbabb8f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:38.726443 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8300456b-6394-44e4-98f9-a4c78cbabb8f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:38.965695 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8300456b-6394-44e4-98f9-a4c78cbabb8f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:38.973913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8300456b-6394-44e4-98f9-a4c78cbabb8f tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.263557 May 16 15:26:38.974685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 471/938] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:38 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:39.999144 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b6688345-8251-4fa6-964c-a5f5322eb9c2 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:39.999873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b6688345-8251-4fa6-964c-a5f5322eb9c2 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:40.006294 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6688345-8251-4fa6-964c-a5f5322eb9c2 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:40.006740 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6688345-8251-4fa6-964c-a5f5322eb9c2 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:40.007502 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6688345-8251-4fa6-964c-a5f5322eb9c2 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:40.007962 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b6688345-8251-4fa6-964c-a5f5322eb9c2 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:40.140908 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b6688345-8251-4fa6-964c-a5f5322eb9c2 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:40.148490 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b6688345-8251-4fa6-964c-a5f5322eb9c2 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.155300 May 16 15:26:40.149103 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 468/939] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:39 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:41.166047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e710591e-c6f2-47dd-af20-d486e5d59b73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:41.166669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e710591e-c6f2-47dd-af20-d486e5d59b73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:41.172826 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e710591e-c6f2-47dd-af20-d486e5d59b73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.173275 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e710591e-c6f2-47dd-af20-d486e5d59b73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.174030 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e710591e-c6f2-47dd-af20-d486e5d59b73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.174460 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e710591e-c6f2-47dd-af20-d486e5d59b73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.302397 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e710591e-c6f2-47dd-af20-d486e5d59b73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:41.310213 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e710591e-c6f2-47dd-af20-d486e5d59b73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.147988 May 16 15:26:41.310788 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 472/940] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:41 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:42.327140 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-def9aa3b-7e49-4e03-bc56-204dfa2b57f0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:42.327815 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-def9aa3b-7e49-4e03-bc56-204dfa2b57f0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:42.334116 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-def9aa3b-7e49-4e03-bc56-204dfa2b57f0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:42.334561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-def9aa3b-7e49-4e03-bc56-204dfa2b57f0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:42.335319 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-def9aa3b-7e49-4e03-bc56-204dfa2b57f0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:42.335811 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-def9aa3b-7e49-4e03-bc56-204dfa2b57f0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:42.462130 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-def9aa3b-7e49-4e03-bc56-204dfa2b57f0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:42.469683 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-def9aa3b-7e49-4e03-bc56-204dfa2b57f0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.146308 May 16 15:26:42.470253 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 469/941] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:42 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:43.486136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-53ea6f6c-bbd2-4281-b19a-a7cefe14adff tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:43.486776 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-53ea6f6c-bbd2-4281-b19a-a7cefe14adff tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:43.493167 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53ea6f6c-bbd2-4281-b19a-a7cefe14adff tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:43.493620 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53ea6f6c-bbd2-4281-b19a-a7cefe14adff tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:43.494904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53ea6f6c-bbd2-4281-b19a-a7cefe14adff tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:43.495344 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-53ea6f6c-bbd2-4281-b19a-a7cefe14adff tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:43.624145 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-53ea6f6c-bbd2-4281-b19a-a7cefe14adff tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:43.631397 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-53ea6f6c-bbd2-4281-b19a-a7cefe14adff tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.149114 May 16 15:26:43.631980 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 473/942] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:43 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:44.648859 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e2a3589b-d750-4084-b6fa-0971f3755d68 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:44.649504 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e2a3589b-d750-4084-b6fa-0971f3755d68 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:44.656184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e2a3589b-d750-4084-b6fa-0971f3755d68 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:44.656639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e2a3589b-d750-4084-b6fa-0971f3755d68 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:44.657405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e2a3589b-d750-4084-b6fa-0971f3755d68 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:44.657841 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e2a3589b-d750-4084-b6fa-0971f3755d68 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:44.793295 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e2a3589b-d750-4084-b6fa-0971f3755d68 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:44.805779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e2a3589b-d750-4084-b6fa-0971f3755d68 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.160940 May 16 15:26:44.806407 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 470/943] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:44 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:45.821944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-521b421f-14aa-4d89-8094-cba5cfb566be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:45.822830 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-521b421f-14aa-4d89-8094-cba5cfb566be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:45.828870 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-521b421f-14aa-4d89-8094-cba5cfb566be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:45.829316 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-521b421f-14aa-4d89-8094-cba5cfb566be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:45.830074 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-521b421f-14aa-4d89-8094-cba5cfb566be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:45.830504 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-521b421f-14aa-4d89-8094-cba5cfb566be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:45.959810 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-521b421f-14aa-4d89-8094-cba5cfb566be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:45.967611 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-521b421f-14aa-4d89-8094-cba5cfb566be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.149506 May 16 15:26:45.968185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 474/944] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:45 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:46.984494 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-09545173-060c-4ca5-89b5-9e525618cde1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:46.985156 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-09545173-060c-4ca5-89b5-9e525618cde1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:46.991461 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-09545173-060c-4ca5-89b5-9e525618cde1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:46.991951 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-09545173-060c-4ca5-89b5-9e525618cde1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:46.992722 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-09545173-060c-4ca5-89b5-9e525618cde1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:46.993159 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-09545173-060c-4ca5-89b5-9e525618cde1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:47.122166 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-09545173-060c-4ca5-89b5-9e525618cde1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:47.129406 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-09545173-060c-4ca5-89b5-9e525618cde1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.148803 May 16 15:26:47.130004 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 471/945] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:46 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:48.146381 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a9a60be7-f9df-418c-995b-a51d59d20a9e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:48.146924 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a9a60be7-f9df-418c-995b-a51d59d20a9e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:48.154444 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a9a60be7-f9df-418c-995b-a51d59d20a9e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:48.154895 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a9a60be7-f9df-418c-995b-a51d59d20a9e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:48.155685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a9a60be7-f9df-418c-995b-a51d59d20a9e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:48.156126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a9a60be7-f9df-418c-995b-a51d59d20a9e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:48.288300 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a9a60be7-f9df-418c-995b-a51d59d20a9e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:48.296201 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a9a60be7-f9df-418c-995b-a51d59d20a9e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.154014 May 16 15:26:48.296767 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 475/946] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:48 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:49.104959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-b117dcb4-5b1d-4662-a15b-2e3f167451ec req-47e27399-6660-43c5-9b63-607b702998be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf88b0c-dcde-4971-add1-d08786fa819e", "name": "network-vif-plugged", "status": "completed", "tag": "adc3da56-eadd-4439-888a-efe0eb7ab5cf"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:49.112839 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-b117dcb4-5b1d-4662-a15b-2e3f167451ec req-47e27399-6660-43c5-9b63-607b702998be service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.113309 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-b117dcb4-5b1d-4662-a15b-2e3f167451ec req-47e27399-6660-43c5-9b63-607b702998be service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.124479 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-b117dcb4-5b1d-4662-a15b-2e3f167451ec req-47e27399-6660-43c5-9b63-607b702998be service nova] Creating event network-vif-plugged:adc3da56-eadd-4439-888a-efe0eb7ab5cf for instance fdf88b0c-dcde-4971-add1-d08786fa819e on hv-cinder-84175 May 16 15:26:49.129762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-b117dcb4-5b1d-4662-a15b-2e3f167451ec req-47e27399-6660-43c5-9b63-607b702998be service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253119 May 16 15:26:49.130464 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 472/947] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:49.312809 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fea43ec2-8584-4f5b-9419-e85e5641111b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:49.313356 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fea43ec2-8584-4f5b-9419-e85e5641111b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:49.319867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fea43ec2-8584-4f5b-9419-e85e5641111b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.320323 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fea43ec2-8584-4f5b-9419-e85e5641111b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.321094 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fea43ec2-8584-4f5b-9419-e85e5641111b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.321541 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fea43ec2-8584-4f5b-9419-e85e5641111b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.661740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-fea43ec2-8584-4f5b-9419-e85e5641111b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:49.669485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-fea43ec2-8584-4f5b-9419-e85e5641111b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.360654 May 16 15:26:49.670036 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 476/948] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:49 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:50.686809 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4e7ee919-c4e9-468e-8276-90c44cc343a0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:50.687503 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4e7ee919-c4e9-468e-8276-90c44cc343a0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:50.694001 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4e7ee919-c4e9-468e-8276-90c44cc343a0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:50.694445 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4e7ee919-c4e9-468e-8276-90c44cc343a0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:50.695204 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4e7ee919-c4e9-468e-8276-90c44cc343a0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:50.695653 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4e7ee919-c4e9-468e-8276-90c44cc343a0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:50.823461 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4e7ee919-c4e9-468e-8276-90c44cc343a0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:50.830895 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4e7ee919-c4e9-468e-8276-90c44cc343a0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1258 microversion: 2.1 time: 0.148424 May 16 15:26:50.831465 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 473/949] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:50 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:51.848048 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-32eefaee-2c8e-4967-b5d3-b3424addd256 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:51.848667 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-32eefaee-2c8e-4967-b5d3-b3424addd256 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:51.855878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-32eefaee-2c8e-4967-b5d3-b3424addd256 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:51.856331 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-32eefaee-2c8e-4967-b5d3-b3424addd256 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:51.857099 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-32eefaee-2c8e-4967-b5d3-b3424addd256 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:51.857536 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-32eefaee-2c8e-4967-b5d3-b3424addd256 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:51.987301 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-32eefaee-2c8e-4967-b5d3-b3424addd256 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:51.995218 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-32eefaee-2c8e-4967-b5d3-b3424addd256 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1441 microversion: 2.1 time: 0.150957 May 16 15:26:51.995793 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 477/950] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:51 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1441 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:52.063358 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5fc03145-0796-4fa9-8465-e4a77be1f197 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:52.064013 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5fc03145-0796-4fa9-8465-e4a77be1f197 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:52.070266 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5fc03145-0796-4fa9-8465-e4a77be1f197 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:52.070707 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5fc03145-0796-4fa9-8465-e4a77be1f197 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:52.071458 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5fc03145-0796-4fa9-8465-e4a77be1f197 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:52.072635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5fc03145-0796-4fa9-8465-e4a77be1f197 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:52.200957 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5fc03145-0796-4fa9-8465-e4a77be1f197 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:52.208265 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5fc03145-0796-4fa9-8465-e4a77be1f197 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1441 microversion: 2.1 time: 0.148774 May 16 15:26:52.208873 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 474/951] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:26:52 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1441 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:54.515608 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-58d4b8a9-64fa-4c30-9a50-b63a46ebc66b req-5962bdee-f628-4dad-9933-4bd47fa3d7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf88b0c-dcde-4971-add1-d08786fa819e", "tag": "adc3da56-eadd-4439-888a-efe0eb7ab5cf"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:54.524150 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-58d4b8a9-64fa-4c30-9a50-b63a46ebc66b req-5962bdee-f628-4dad-9933-4bd47fa3d7eb service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:54.524603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-58d4b8a9-64fa-4c30-9a50-b63a46ebc66b req-5962bdee-f628-4dad-9933-4bd47fa3d7eb service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:54.535883 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-58d4b8a9-64fa-4c30-9a50-b63a46ebc66b req-5962bdee-f628-4dad-9933-4bd47fa3d7eb service nova] Creating event network-changed:adc3da56-eadd-4439-888a-efe0eb7ab5cf for instance fdf88b0c-dcde-4971-add1-d08786fa819e on hv-cinder-84175 May 16 15:26:54.541607 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-58d4b8a9-64fa-4c30-9a50-b63a46ebc66b req-5962bdee-f628-4dad-9933-4bd47fa3d7eb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028908 May 16 15:26:54.542371 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 478/952] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:48.855645 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0867896a-4564-4041-a487-fbe64a67068c tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:48.856750 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0867896a-4564-4041-a487-fbe64a67068c tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:48.862639 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0867896a-4564-4041-a487-fbe64a67068c tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:48.863082 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0867896a-4564-4041-a487-fbe64a67068c tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:48.863867 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0867896a-4564-4041-a487-fbe64a67068c tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:48.864301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0867896a-4564-4041-a487-fbe64a67068c tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:48.890261 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-0867896a-4564-4041-a487-fbe64a67068c tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lazy-loading 'flavor' on Instance uuid fdf88b0c-dcde-4971-add1-d08786fa819e {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:28:49.136523 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0867896a-4564-4041-a487-fbe64a67068c tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "POST /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e/action" status: 202 len: 0 microversion: 2.1 time: 0.285417 May 16 15:28:49.137015 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 475/953] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:28:48 2022] POST /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:28:49.144109 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6f046a5-460d-403f-8077-f1c9b9c0d285] AMQP server on 10.222.0.71:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 16 15:28:49.148221 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-4c09ffd8-af41-4dd0-9af4-79332da8070d tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:49.148949 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-4c09ffd8-af41-4dd0-9af4-79332da8070d tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:49.156112 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c09ffd8-af41-4dd0-9af4-79332da8070d tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.160159 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c09ffd8-af41-4dd0-9af4-79332da8070d tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.160159 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c09ffd8-af41-4dd0-9af4-79332da8070d tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.160159 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-4c09ffd8-af41-4dd0-9af4-79332da8070d tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.290950 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-4c09ffd8-af41-4dd0-9af4-79332da8070d tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:49.299420 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-4c09ffd8-af41-4dd0-9af4-79332da8070d tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.157496 May 16 15:28:49.299985 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 479/954] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:49 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:50.318170 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-9736623d-4941-41fd-a592-63645b85d0c8 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:50.318856 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-9736623d-4941-41fd-a592-63645b85d0c8 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:50.324981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9736623d-4941-41fd-a592-63645b85d0c8 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:50.325426 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9736623d-4941-41fd-a592-63645b85d0c8 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:50.326363 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9736623d-4941-41fd-a592-63645b85d0c8 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:50.326792 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-9736623d-4941-41fd-a592-63645b85d0c8 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:50.454499 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-9736623d-4941-41fd-a592-63645b85d0c8 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:50.461846 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-9736623d-4941-41fd-a592-63645b85d0c8 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.148390 May 16 15:28:50.462411 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 476/955] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:50 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:51.479045 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-8dc640b9-c3c2-4d15-a8f5-0f0a788af6be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:51.479677 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-8dc640b9-c3c2-4d15-a8f5-0f0a788af6be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:51.488735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8dc640b9-c3c2-4d15-a8f5-0f0a788af6be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:51.489185 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8dc640b9-c3c2-4d15-a8f5-0f0a788af6be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:51.489989 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8dc640b9-c3c2-4d15-a8f5-0f0a788af6be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:51.490427 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-8dc640b9-c3c2-4d15-a8f5-0f0a788af6be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:51.495513 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6f046a5-460d-403f-8077-f1c9b9c0d285] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 34418. May 16 15:28:51.616302 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-8dc640b9-c3c2-4d15-a8f5-0f0a788af6be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:51.623535 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-8dc640b9-c3c2-4d15-a8f5-0f0a788af6be tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.148324 May 16 15:28:51.624116 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 480/956] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:51 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:52.640577 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2688230e-70d2-434e-8c1c-26d306d75f12 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:52.641118 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2688230e-70d2-434e-8c1c-26d306d75f12 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:52.647699 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2688230e-70d2-434e-8c1c-26d306d75f12 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:52.648150 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2688230e-70d2-434e-8c1c-26d306d75f12 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:52.648907 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2688230e-70d2-434e-8c1c-26d306d75f12 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:52.649335 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2688230e-70d2-434e-8c1c-26d306d75f12 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:52.779613 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2688230e-70d2-434e-8c1c-26d306d75f12 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:52.786872 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2688230e-70d2-434e-8c1c-26d306d75f12 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.150290 May 16 15:28:52.787434 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 477/957] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:52 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:53.803459 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0f261a17-7f7a-434f-851d-0ea6f5210cb7 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:53.804104 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0f261a17-7f7a-434f-851d-0ea6f5210cb7 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:53.810625 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0f261a17-7f7a-434f-851d-0ea6f5210cb7 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:53.811068 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0f261a17-7f7a-434f-851d-0ea6f5210cb7 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:53.811913 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0f261a17-7f7a-434f-851d-0ea6f5210cb7 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:53.812345 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0f261a17-7f7a-434f-851d-0ea6f5210cb7 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:53.937617 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0f261a17-7f7a-434f-851d-0ea6f5210cb7 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:53.945049 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0f261a17-7f7a-434f-851d-0ea6f5210cb7 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.145478 May 16 15:28:53.945607 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 481/958] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:53 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:54.962162 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-36c064a3-de99-445b-9519-c82779067370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:54.962771 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-36c064a3-de99-445b-9519-c82779067370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:54.969553 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-36c064a3-de99-445b-9519-c82779067370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:54.969997 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-36c064a3-de99-445b-9519-c82779067370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:54.970757 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-36c064a3-de99-445b-9519-c82779067370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:54.971192 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-36c064a3-de99-445b-9519-c82779067370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:55.101812 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-36c064a3-de99-445b-9519-c82779067370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:55.110024 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-36c064a3-de99-445b-9519-c82779067370 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.151711 May 16 15:28:55.110587 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 478/959] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:54 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:56.127340 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-56988da4-8156-403b-a499-b4edef43e776 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:56.127911 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-56988da4-8156-403b-a499-b4edef43e776 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:56.134219 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-56988da4-8156-403b-a499-b4edef43e776 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:56.134669 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-56988da4-8156-403b-a499-b4edef43e776 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:56.135430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-56988da4-8156-403b-a499-b4edef43e776 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:56.135894 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-56988da4-8156-403b-a499-b4edef43e776 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:56.263667 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-56988da4-8156-403b-a499-b4edef43e776 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:56.271343 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-56988da4-8156-403b-a499-b4edef43e776 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.147907 May 16 15:28:56.271943 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 482/960] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:56 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:57.288457 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-886af618-59c2-41dc-8cf4-600a7a59b791 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:57.289068 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-886af618-59c2-41dc-8cf4-600a7a59b791 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:57.295074 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-886af618-59c2-41dc-8cf4-600a7a59b791 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:57.295514 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-886af618-59c2-41dc-8cf4-600a7a59b791 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:57.296297 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-886af618-59c2-41dc-8cf4-600a7a59b791 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:57.296727 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-886af618-59c2-41dc-8cf4-600a7a59b791 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:57.425941 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-886af618-59c2-41dc-8cf4-600a7a59b791 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:57.433135 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-886af618-59c2-41dc-8cf4-600a7a59b791 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.148517 May 16 15:28:57.433696 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 479/961] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:57 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:58.451491 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3bd2a030-87b3-4d26-8b43-fa765b891ce9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:58.452386 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3bd2a030-87b3-4d26-8b43-fa765b891ce9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:58.460737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3bd2a030-87b3-4d26-8b43-fa765b891ce9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:58.461181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3bd2a030-87b3-4d26-8b43-fa765b891ce9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:58.461988 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3bd2a030-87b3-4d26-8b43-fa765b891ce9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:58.462418 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3bd2a030-87b3-4d26-8b43-fa765b891ce9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:58.593350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3bd2a030-87b3-4d26-8b43-fa765b891ce9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:58.600755 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3bd2a030-87b3-4d26-8b43-fa765b891ce9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.153983 May 16 15:28:58.601379 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 483/962] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:58 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:59.618196 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-06a714f4-9f2a-4fb5-bd73-8005bebbfd7e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:59.618830 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-06a714f4-9f2a-4fb5-bd73-8005bebbfd7e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:59.626803 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-06a714f4-9f2a-4fb5-bd73-8005bebbfd7e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:59.627249 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-06a714f4-9f2a-4fb5-bd73-8005bebbfd7e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:59.628041 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-06a714f4-9f2a-4fb5-bd73-8005bebbfd7e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:59.628469 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-06a714f4-9f2a-4fb5-bd73-8005bebbfd7e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:59.825139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-06a714f4-9f2a-4fb5-bd73-8005bebbfd7e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:59.833163 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-06a714f4-9f2a-4fb5-bd73-8005bebbfd7e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.218832 May 16 15:28:59.833946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 480/963] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:28:59 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:00.850661 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-acf7652b-f0bc-4786-a345-76ee90cb8bf0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:00.851319 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-acf7652b-f0bc-4786-a345-76ee90cb8bf0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:00.857736 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acf7652b-f0bc-4786-a345-76ee90cb8bf0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:00.858217 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acf7652b-f0bc-4786-a345-76ee90cb8bf0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:00.858988 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acf7652b-f0bc-4786-a345-76ee90cb8bf0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:00.859429 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-acf7652b-f0bc-4786-a345-76ee90cb8bf0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:00.988492 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-acf7652b-f0bc-4786-a345-76ee90cb8bf0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:00.995869 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-acf7652b-f0bc-4786-a345-76ee90cb8bf0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.149016 May 16 15:29:00.996428 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 484/964] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:00 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:02.012441 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5be44c7b-15d8-4c98-84d1-84bd20d0ac13 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:02.013470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5be44c7b-15d8-4c98-84d1-84bd20d0ac13 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:02.020125 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5be44c7b-15d8-4c98-84d1-84bd20d0ac13 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:02.020580 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5be44c7b-15d8-4c98-84d1-84bd20d0ac13 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:02.021345 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5be44c7b-15d8-4c98-84d1-84bd20d0ac13 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:02.021780 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5be44c7b-15d8-4c98-84d1-84bd20d0ac13 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:02.156000 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5be44c7b-15d8-4c98-84d1-84bd20d0ac13 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:02.163470 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5be44c7b-15d8-4c98-84d1-84bd20d0ac13 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.154824 May 16 15:29:02.164176 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 481/965] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:02 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:03.181376 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-3f006629-ab09-4183-8950-abf367d8a178 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:03.181920 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-3f006629-ab09-4183-8950-abf367d8a178 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:03.188829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f006629-ab09-4183-8950-abf367d8a178 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:03.189283 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f006629-ab09-4183-8950-abf367d8a178 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:03.190050 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f006629-ab09-4183-8950-abf367d8a178 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:03.190483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-3f006629-ab09-4183-8950-abf367d8a178 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:03.321235 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-3f006629-ab09-4183-8950-abf367d8a178 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:03.328672 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-3f006629-ab09-4183-8950-abf367d8a178 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1506 microversion: 2.1 time: 0.151344 May 16 15:29:03.329222 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 485/966] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:03 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:03.345144 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7efab9ae-62bf-4962-9483-ef4c89e6d17b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:03.345706 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7efab9ae-62bf-4962-9483-ef4c89e6d17b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:03.352013 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7efab9ae-62bf-4962-9483-ef4c89e6d17b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:03.352481 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7efab9ae-62bf-4962-9483-ef4c89e6d17b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:03.353231 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7efab9ae-62bf-4962-9483-ef4c89e6d17b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:03.353660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7efab9ae-62bf-4962-9483-ef4c89e6d17b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:03.667660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7efab9ae-62bf-4962-9483-ef4c89e6d17b tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "POST /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e/action" status: 202 len: 0 microversion: 2.1 time: 0.326781 May 16 15:29:03.668297 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 482/967] 10.222.0.71 () {60 vars in 1277 bytes} [Mon May 16 15:29:03 2022] POST /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:29:03.677216 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0d17ac29-f4cb-4dbd-8c9b-8c94dd6f5b1e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:03.677825 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0d17ac29-f4cb-4dbd-8c9b-8c94dd6f5b1e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:03.683905 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0d17ac29-f4cb-4dbd-8c9b-8c94dd6f5b1e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:03.684488 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0d17ac29-f4cb-4dbd-8c9b-8c94dd6f5b1e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:03.685658 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0d17ac29-f4cb-4dbd-8c9b-8c94dd6f5b1e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:03.685958 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0d17ac29-f4cb-4dbd-8c9b-8c94dd6f5b1e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:03.815508 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0d17ac29-f4cb-4dbd-8c9b-8c94dd6f5b1e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:03.822976 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0d17ac29-f4cb-4dbd-8c9b-8c94dd6f5b1e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1514 microversion: 2.1 time: 0.149673 May 16 15:29:03.823543 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 486/968] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:03 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:04.841787 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b07d1ba4-c153-48bc-9886-7b422a56c083 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:04.842413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b07d1ba4-c153-48bc-9886-7b422a56c083 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:04.848445 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b07d1ba4-c153-48bc-9886-7b422a56c083 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:04.848901 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b07d1ba4-c153-48bc-9886-7b422a56c083 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:04.849676 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b07d1ba4-c153-48bc-9886-7b422a56c083 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:04.850112 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b07d1ba4-c153-48bc-9886-7b422a56c083 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:04.981865 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b07d1ba4-c153-48bc-9886-7b422a56c083 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:04.989548 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b07d1ba4-c153-48bc-9886-7b422a56c083 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1516 microversion: 2.1 time: 0.152730 May 16 15:29:04.990157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 483/969] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:04 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:05.420851 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-8eac28e6-7cc4-4590-b60a-14f4eaabf3a2 req-0d3c9c25-3e76-4269-b659-aa38831eb0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf88b0c-dcde-4971-add1-d08786fa819e", "name": "network-vif-unplugged", "status": "completed", "tag": "adc3da56-eadd-4439-888a-efe0eb7ab5cf"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:05.429172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-8eac28e6-7cc4-4590-b60a-14f4eaabf3a2 req-0d3c9c25-3e76-4269-b659-aa38831eb0d7 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:05.429615 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-8eac28e6-7cc4-4590-b60a-14f4eaabf3a2 req-0d3c9c25-3e76-4269-b659-aa38831eb0d7 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:05.441169 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.compute.server_external_events [req-8eac28e6-7cc4-4590-b60a-14f4eaabf3a2 req-0d3c9c25-3e76-4269-b659-aa38831eb0d7 service nova] Unable to find a host for instance fdf88b0c-dcde-4971-add1-d08786fa819e. Dropping event network-vif-unplugged {{(pid=117676) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 15:29:05.441986 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-8eac28e6-7cc4-4590-b60a-14f4eaabf3a2 req-0d3c9c25-3e76-4269-b659-aa38831eb0d7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025834 May 16 15:29:05.442552 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 487/970] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 16 15:29:06.009110 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-95e97ddc-6876-4824-b7c5-c3ece3ef67a9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:06.009729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-95e97ddc-6876-4824-b7c5-c3ece3ef67a9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:06.017269 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-95e97ddc-6876-4824-b7c5-c3ece3ef67a9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:06.017724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-95e97ddc-6876-4824-b7c5-c3ece3ef67a9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:06.018759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-95e97ddc-6876-4824-b7c5-c3ece3ef67a9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:06.019194 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-95e97ddc-6876-4824-b7c5-c3ece3ef67a9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:06.149940 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-95e97ddc-6876-4824-b7c5-c3ece3ef67a9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:06.158941 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-95e97ddc-6876-4824-b7c5-c3ece3ef67a9 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.153773 May 16 15:29:06.159500 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 484/971] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:06 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:07.176847 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a17d9e17-808d-4fb1-a720-46c2d8b62c61 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:07.177369 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a17d9e17-808d-4fb1-a720-46c2d8b62c61 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:07.183655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a17d9e17-808d-4fb1-a720-46c2d8b62c61 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:07.184114 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a17d9e17-808d-4fb1-a720-46c2d8b62c61 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:07.184890 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a17d9e17-808d-4fb1-a720-46c2d8b62c61 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:07.185317 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a17d9e17-808d-4fb1-a720-46c2d8b62c61 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:07.322806 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a17d9e17-808d-4fb1-a720-46c2d8b62c61 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:07.323872 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a17d9e17-808d-4fb1-a720-46c2d8b62c61 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.150909 May 16 15:29:07.324430 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 488/972] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:07 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:08.342990 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-cdf3a099-8861-4f9d-a725-3f419a135669 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:08.343609 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cdf3a099-8861-4f9d-a725-3f419a135669 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:08.349939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cdf3a099-8861-4f9d-a725-3f419a135669 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:08.350389 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cdf3a099-8861-4f9d-a725-3f419a135669 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:08.351155 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cdf3a099-8861-4f9d-a725-3f419a135669 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:08.351593 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cdf3a099-8861-4f9d-a725-3f419a135669 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:08.477625 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-cdf3a099-8861-4f9d-a725-3f419a135669 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:08.485114 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-cdf3a099-8861-4f9d-a725-3f419a135669 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.147086 May 16 15:29:08.485676 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 485/973] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:08 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:09.502167 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f38fca29-32ab-4fa4-8560-ee83ef92c35e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:09.509208 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f38fca29-32ab-4fa4-8560-ee83ef92c35e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:09.509208 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f38fca29-32ab-4fa4-8560-ee83ef92c35e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:09.509560 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f38fca29-32ab-4fa4-8560-ee83ef92c35e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:09.510327 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f38fca29-32ab-4fa4-8560-ee83ef92c35e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:09.510764 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f38fca29-32ab-4fa4-8560-ee83ef92c35e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:09.643403 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f38fca29-32ab-4fa4-8560-ee83ef92c35e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:09.650709 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f38fca29-32ab-4fa4-8560-ee83ef92c35e tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.152373 May 16 15:29:09.651261 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 489/974] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:09 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:10.667946 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-c746b40b-e9ec-4f9a-83c0-97c5fd5873c4 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:10.668591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-c746b40b-e9ec-4f9a-83c0-97c5fd5873c4 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:10.675152 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c746b40b-e9ec-4f9a-83c0-97c5fd5873c4 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:10.675603 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c746b40b-e9ec-4f9a-83c0-97c5fd5873c4 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:10.676393 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c746b40b-e9ec-4f9a-83c0-97c5fd5873c4 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:10.676826 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-c746b40b-e9ec-4f9a-83c0-97c5fd5873c4 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:10.813069 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-c746b40b-e9ec-4f9a-83c0-97c5fd5873c4 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:10.820372 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-c746b40b-e9ec-4f9a-83c0-97c5fd5873c4 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.156347 May 16 15:29:10.820933 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 486/975] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:10 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:11.836978 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-233600af-7e45-4e91-8539-fbe5d3fe6572 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:11.837593 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-233600af-7e45-4e91-8539-fbe5d3fe6572 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:11.845997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-233600af-7e45-4e91-8539-fbe5d3fe6572 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:11.846256 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-233600af-7e45-4e91-8539-fbe5d3fe6572 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:11.847037 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-233600af-7e45-4e91-8539-fbe5d3fe6572 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:11.847496 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-233600af-7e45-4e91-8539-fbe5d3fe6572 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:11.976203 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-233600af-7e45-4e91-8539-fbe5d3fe6572 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:11.983992 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-233600af-7e45-4e91-8539-fbe5d3fe6572 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.150815 May 16 15:29:11.984550 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 490/976] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:11 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:13.001533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-89b710e5-b7dd-4833-a4ce-31f68c91381a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:13.002157 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-89b710e5-b7dd-4833-a4ce-31f68c91381a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:13.008623 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89b710e5-b7dd-4833-a4ce-31f68c91381a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:13.009097 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89b710e5-b7dd-4833-a4ce-31f68c91381a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:13.009869 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89b710e5-b7dd-4833-a4ce-31f68c91381a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:13.010325 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-89b710e5-b7dd-4833-a4ce-31f68c91381a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:13.141747 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-89b710e5-b7dd-4833-a4ce-31f68c91381a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:13.149293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-89b710e5-b7dd-4833-a4ce-31f68c91381a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.152360 May 16 15:29:13.149860 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 487/977] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:12 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:14.166725 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0d5a3514-01db-49e3-b358-5a0c58e42934 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:14.167322 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0d5a3514-01db-49e3-b358-5a0c58e42934 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:14.173638 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0d5a3514-01db-49e3-b358-5a0c58e42934 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:14.174088 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0d5a3514-01db-49e3-b358-5a0c58e42934 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:14.174856 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0d5a3514-01db-49e3-b358-5a0c58e42934 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:14.175297 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0d5a3514-01db-49e3-b358-5a0c58e42934 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:14.301869 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0d5a3514-01db-49e3-b358-5a0c58e42934 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:14.309152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0d5a3514-01db-49e3-b358-5a0c58e42934 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.146318 May 16 15:29:14.309703 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 491/978] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:14 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:15.326762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-86de29f9-dd51-4cd4-baea-20d5a089d7ba tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:15.327404 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-86de29f9-dd51-4cd4-baea-20d5a089d7ba tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:15.333689 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-86de29f9-dd51-4cd4-baea-20d5a089d7ba tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:15.334139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-86de29f9-dd51-4cd4-baea-20d5a089d7ba tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:15.334903 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-86de29f9-dd51-4cd4-baea-20d5a089d7ba tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:15.335371 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-86de29f9-dd51-4cd4-baea-20d5a089d7ba tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:15.468050 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-86de29f9-dd51-4cd4-baea-20d5a089d7ba tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:15.475719 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-86de29f9-dd51-4cd4-baea-20d5a089d7ba tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.153418 May 16 15:29:15.476298 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 488/979] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:15 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:16.492498 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-61998860-c834-4ee3-9673-640fd694353a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:16.493102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-61998860-c834-4ee3-9673-640fd694353a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:16.499579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-61998860-c834-4ee3-9673-640fd694353a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:16.500056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-61998860-c834-4ee3-9673-640fd694353a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:16.500813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-61998860-c834-4ee3-9673-640fd694353a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:16.501241 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-61998860-c834-4ee3-9673-640fd694353a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:16.628226 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-61998860-c834-4ee3-9673-640fd694353a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:16.635819 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-61998860-c834-4ee3-9673-640fd694353a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.147125 May 16 15:29:16.636387 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 492/980] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:16 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:17.512268 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-e1c0daa3-2244-4ad4-ad0f-73303164af6d req-1562466c-a465-4cd2-997f-d9a2a8614c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf88b0c-dcde-4971-add1-d08786fa819e", "name": "network-vif-plugged", "status": "completed", "tag": "adc3da56-eadd-4439-888a-efe0eb7ab5cf"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:17.520724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-e1c0daa3-2244-4ad4-ad0f-73303164af6d req-1562466c-a465-4cd2-997f-d9a2a8614c57 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:17.521146 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-e1c0daa3-2244-4ad4-ad0f-73303164af6d req-1562466c-a465-4cd2-997f-d9a2a8614c57 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:17.532065 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-e1c0daa3-2244-4ad4-ad0f-73303164af6d req-1562466c-a465-4cd2-997f-d9a2a8614c57 service nova] Creating event network-vif-plugged:adc3da56-eadd-4439-888a-efe0eb7ab5cf for instance fdf88b0c-dcde-4971-add1-d08786fa819e on hv-cinder-84175 May 16 15:29:17.537262 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-e1c0daa3-2244-4ad4-ad0f-73303164af6d req-1562466c-a465-4cd2-997f-d9a2a8614c57 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028436 May 16 15:29:17.537565 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 489/981] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:17.652721 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a53a7c29-4939-404a-9740-5d568535dd73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:17.653368 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a53a7c29-4939-404a-9740-5d568535dd73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:17.660553 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a53a7c29-4939-404a-9740-5d568535dd73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:17.661102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a53a7c29-4939-404a-9740-5d568535dd73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:17.661865 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a53a7c29-4939-404a-9740-5d568535dd73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:17.662297 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-a53a7c29-4939-404a-9740-5d568535dd73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:17.796604 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a53a7c29-4939-404a-9740-5d568535dd73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:17.804065 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a53a7c29-4939-404a-9740-5d568535dd73 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.155086 May 16 15:29:17.804629 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 493/982] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:17 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:18.821596 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-bfefe4d4-5479-40f6-b203-50f82e6b5f85 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:18.822411 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-bfefe4d4-5479-40f6-b203-50f82e6b5f85 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:18.829055 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bfefe4d4-5479-40f6-b203-50f82e6b5f85 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:18.829508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bfefe4d4-5479-40f6-b203-50f82e6b5f85 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:18.830285 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bfefe4d4-5479-40f6-b203-50f82e6b5f85 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:18.830724 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-bfefe4d4-5479-40f6-b203-50f82e6b5f85 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:19.041336 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-bfefe4d4-5479-40f6-b203-50f82e6b5f85 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:19.049610 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-bfefe4d4-5479-40f6-b203-50f82e6b5f85 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1572 microversion: 2.1 time: 0.232658 May 16 15:29:19.050405 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 490/983] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:18 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1572 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:20.066995 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-91563365-34ac-47ab-b1d4-d3270e612a05 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:20.067686 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-91563365-34ac-47ab-b1d4-d3270e612a05 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:20.073974 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-91563365-34ac-47ab-b1d4-d3270e612a05 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:20.074467 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-91563365-34ac-47ab-b1d4-d3270e612a05 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:20.075795 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-91563365-34ac-47ab-b1d4-d3270e612a05 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:20.076402 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-91563365-34ac-47ab-b1d4-d3270e612a05 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:20.204219 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-91563365-34ac-47ab-b1d4-d3270e612a05 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:20.211483 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-91563365-34ac-47ab-b1d4-d3270e612a05 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1559 microversion: 2.1 time: 0.149145 May 16 15:29:20.212078 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 494/984] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:29:20 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:36.715730 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-abd1f055-ae6c-47b4-91f9-6834e4dfa8ef req-980c265b-1943-4fc5-8823-64b4ae684858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf88b0c-dcde-4971-add1-d08786fa819e", "tag": "adc3da56-eadd-4439-888a-efe0eb7ab5cf"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:30:36.719593 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5c485d5e-6264-46da-847b-105bba92bedb tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:36.720184 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5c485d5e-6264-46da-847b-105bba92bedb tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:36.728738 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5c485d5e-6264-46da-847b-105bba92bedb tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:36.734238 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5c485d5e-6264-46da-847b-105bba92bedb tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:36.734238 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5c485d5e-6264-46da-847b-105bba92bedb tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:36.734238 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5c485d5e-6264-46da-847b-105bba92bedb tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:36.734902 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-abd1f055-ae6c-47b4-91f9-6834e4dfa8ef req-980c265b-1943-4fc5-8823-64b4ae684858 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:36.734902 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-abd1f055-ae6c-47b4-91f9-6834e4dfa8ef req-980c265b-1943-4fc5-8823-64b4ae684858 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:36.745690 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-abd1f055-ae6c-47b4-91f9-6834e4dfa8ef req-980c265b-1943-4fc5-8823-64b4ae684858 service nova] Creating event network-changed:adc3da56-eadd-4439-888a-efe0eb7ab5cf for instance fdf88b0c-dcde-4971-add1-d08786fa819e on hv-cinder-84175 May 16 15:30:36.754293 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-abd1f055-ae6c-47b4-91f9-6834e4dfa8ef req-980c265b-1943-4fc5-8823-64b4ae684858 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040880 May 16 15:30:36.757039 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 495/985] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:36.761052 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5c485d5e-6264-46da-847b-105bba92bedb tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:30:37.101475 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5c485d5e-6264-46da-847b-105bba92bedb tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "DELETE /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 204 len: 0 microversion: 2.1 time: 0.396458 May 16 15:30:37.102871 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 491/986] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:30:36 2022] DELETE /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:30:37.110797 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d5b45d76-9852-44f5-b2a8-1461a33e6cb1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:37.113333 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d5b45d76-9852-44f5-b2a8-1461a33e6cb1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:37.123829 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d5b45d76-9852-44f5-b2a8-1461a33e6cb1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:37.125007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d5b45d76-9852-44f5-b2a8-1461a33e6cb1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:37.126058 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d5b45d76-9852-44f5-b2a8-1461a33e6cb1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:37.126576 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d5b45d76-9852-44f5-b2a8-1461a33e6cb1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:37.332614 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d5b45d76-9852-44f5-b2a8-1461a33e6cb1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:37.346283 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d5b45d76-9852-44f5-b2a8-1461a33e6cb1 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.238880 May 16 15:30:37.347896 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 496/987] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:30:37 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:38.365190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-aab4620f-6f90-4526-847c-e66a21dfc35a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:38.366612 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-aab4620f-6f90-4526-847c-e66a21dfc35a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:38.373409 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aab4620f-6f90-4526-847c-e66a21dfc35a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:38.373858 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aab4620f-6f90-4526-847c-e66a21dfc35a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:38.374626 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aab4620f-6f90-4526-847c-e66a21dfc35a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:38.375062 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-aab4620f-6f90-4526-847c-e66a21dfc35a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:38.573009 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-aab4620f-6f90-4526-847c-e66a21dfc35a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:38.580593 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-aab4620f-6f90-4526-847c-e66a21dfc35a tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1565 microversion: 2.1 time: 0.220413 May 16 15:30:38.583671 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 492/988] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:30:38 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1565 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:39.267967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-65176ab2-f11b-4d5b-9030-4b1cee172ed8 req-138e8a0f-bf70-4ae2-9b88-7a0db4d9e4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf88b0c-dcde-4971-add1-d08786fa819e", "name": "network-vif-deleted", "tag": "adc3da56-eadd-4439-888a-efe0eb7ab5cf"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:30:39.276485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-65176ab2-f11b-4d5b-9030-4b1cee172ed8 req-138e8a0f-bf70-4ae2-9b88-7a0db4d9e4cd service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:39.276935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-65176ab2-f11b-4d5b-9030-4b1cee172ed8 req-138e8a0f-bf70-4ae2-9b88-7a0db4d9e4cd service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:39.290812 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-65176ab2-f11b-4d5b-9030-4b1cee172ed8 req-138e8a0f-bf70-4ae2-9b88-7a0db4d9e4cd service nova] Creating event network-vif-deleted:adc3da56-eadd-4439-888a-efe0eb7ab5cf for instance fdf88b0c-dcde-4971-add1-d08786fa819e on hv-cinder-84175 May 16 15:30:39.295655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-65176ab2-f11b-4d5b-9030-4b1cee172ed8 req-138e8a0f-bf70-4ae2-9b88-7a0db4d9e4cd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 May 16 15:30:39.296241 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 497/989] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:39.599203 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-6dc44e30-6140-4375-8f6b-395a68b98f15 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:39.599981 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-6dc44e30-6140-4375-8f6b-395a68b98f15 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:39.606866 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6dc44e30-6140-4375-8f6b-395a68b98f15 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:39.607594 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6dc44e30-6140-4375-8f6b-395a68b98f15 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:39.608591 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6dc44e30-6140-4375-8f6b-395a68b98f15 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:39.609026 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-6dc44e30-6140-4375-8f6b-395a68b98f15 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:39.681332 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-6dc44e30-6140-4375-8f6b-395a68b98f15 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:39.689151 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-6dc44e30-6140-4375-8f6b-395a68b98f15 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1218 microversion: 2.1 time: 0.094673 May 16 15:30:39.689731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 493/990] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:30:39 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:40.708329 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:40.709764 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:40.716246 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:40.717013 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:40.717795 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:40.718233 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:40.753520 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:40.754233 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:40.754691 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.objects.instance [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lazy-loading 'fault' on Instance uuid fdf88b0c-dcde-4971-add1-d08786fa819e {{(pid=117676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:30:40.799260 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3715d415c2e24297a30a4c948c2677ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cef808bf8324f5b852fd0ea7f368f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:40.807667 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-c231da11-b03d-4021-9b97-b470dedf7dbe tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 200 len: 1223 microversion: 2.1 time: 0.104901 May 16 15:30:40.808255 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 498/991] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:30:40 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:30:41.824090 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:41.824703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] [instance: fdf88b0c-dcde-4971-add1-d08786fa819e] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:41.831063 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:41.831513 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:41.832322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:41.832757 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:41.845814 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] HTTP exception thrown: Instance fdf88b0c-dcde-4971-add1-d08786fa819e could not be found. May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Request method failure captured: May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e HTTP/1.1 May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigm0OiA3EpY3UAZslzlD9Nei6W1zFF-5gw0PaKPovWEIj6Jk6eTnzRDMSXpDOy74SE9UkNhYvPQ34E4u3X34OAffh-x65dRfBZXxXVepZ--XtW97THQEIUJuLQYxbkAigb05wsF4Z1P3nqVjTwAt4o3FrMEEKaFqWgWQTrWCTR7-MHVk May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 5cef808bf8324f5b852fd0ea7f368f6d May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-TestShelveInstance-569677651 May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:30:41.847438 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5cef808bf8324f5b852fd0ea7f368f6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5cef808bf8324f5b852fd0ea7f368f6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5cef808bf8324f5b852fd0ea7f368f6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5cef808bf8324f5b852fd0ea7f368f6d"}]}] May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-TestShelveInstance-569677651 May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 5cef808bf8324f5b852fd0ea7f368f6d May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-TestShelveInstance-569677651 May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-TestShelveInstance-569677651-project May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 3715d415c2e24297a30a4c948c2677ef May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-TestShelveInstance-569677651-project May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance fdf88b0c-dcde-4971-add1-d08786fa819e could not be found. May 16 15:30:41.849315 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': 'fdf88b0c-dcde-4971-add1-d08786fa819e'} May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf88b0c-dcde-4971-add1-d08786fa819e could not be found. May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:30:41.850369 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf88b0c-dcde-4971-add1-d08786fa819e could not be found. May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf88b0c-dcde-4971-add1-d08786fa819e could not be found. May 16 15:30:41.852043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:30:41.853690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Returning 404 to user: Instance fdf88b0c-dcde-4971-add1-d08786fa819e could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:30:41.853690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-a52296e7-baeb-43ed-9f8b-27e2d4b54a93 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e" status: 404 len: 111 microversion: 2.1 time: 0.028697 May 16 15:30:41.853690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 494/992] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:30:41 2022] GET /compute/v2.1/servers/fdf88b0c-dcde-4971-add1-d08786fa819e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:30:42.078655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f113f799-04f1-43f0-8e98-dc413c2ce3e0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] Calling method '.version_select at 0x7f0c835cda60>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:42.154975 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f113f799-04f1-43f0-8e98-dc413c2ce3e0 tempest-TestShelveInstance-569677651 tempest-TestShelveInstance-569677651-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1366159048" status: 202 len: 0 microversion: 2.1 time: 0.080079 May 16 15:30:42.155553 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 499/993] 10.222.0.71 () {58 vars in 1253 bytes} [Mon May 16 15:30:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1366159048 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:31:03.251614 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-8ceb76c2-3d32-4b35-ae21-1184b877b637 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Action: 'create', calling method: .version_select at 0x7f0c882593a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-357988655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQgESk9LJ+0a6RyBJH99X2yp7CCHzydZHbUPCiu01o0wgddhkwysJPcD8GHx39XtuU/CyK0gpOCRQy27am/YHnvIHdcKqs/Y50z82smSQiWYLFY6jfoinFDj4yGiSlckQ=="}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:03.266215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-8ceb76c2-3d32-4b35-ae21-1184b877b637 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Getting quotas for project 35be16de8a104d569efbb5633c5036af. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:31:03.270951 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-8ceb76c2-3d32-4b35-ae21-1184b877b637 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Getting quotas for user 1f3e4b15a6cc4879b24d7a44669a3690 and project 35be16de8a104d569efbb5633c5036af. Resources: {'key_pairs'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:31:03.338233 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-8ceb76c2-3d32-4b35-ae21-1184b877b637 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.255695 May 16 15:31:03.338936 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 495/994] 10.222.0.71 () {60 vars in 1158 bytes} [Mon May 16 15:31:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:21.283411 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-767615823", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-357988655", "security_groups": [{"name": "tempest-secgroup-smoke-2082613032"}], "block_device_mapping_v2": [{"uuid": "235f10b5-1005-4566-92ca-0d4c96707403", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e5b8e9b-f5ed-471c-99f0-3d6ef4d85cce"}]}} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:21.391136 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.network.neutron [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] validate_networks() for [('9e5b8e9b-f5ed-471c-99f0-3d6ef4d85cce', None, None, None, None, None)] {{(pid=117676) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:31:21.840238 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Flavor limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:31:21.840737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Image limits 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:31:21.841288 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Flavor pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:31:21.841731 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Image pref 0:0:0 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:31:21.842144 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.virt.hardware [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:31:21.851769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:21.852218 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:21.853024 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:21.853465 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:21.870304 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Getting quotas for project 35be16de8a104d569efbb5633c5036af. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:31:21.874143 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.quota [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Getting quotas for user 1f3e4b15a6cc4879b24d7a44669a3690 and project 35be16de8a104d569efbb5633c5036af. Resources: {'instances', 'cores', 'ram'} {{(pid=117676) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:31:21.930585 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Going to run 1 instances... {{(pid=117676) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:31:21.932664 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='235f10b5-1005-4566-92ca-0d4c96707403',volume_size=None,volume_type=None)] {{(pid=117676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:31:22.314903 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR oslo.messaging._drivers.impl_rabbit [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [88102b6c-f214-4a7c-867b-96033504ffea] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 15:31:23.323364 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [88102b6c-f214-4a7c-867b-96033504ffea] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 34772. May 16 15:31:23.327016 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-15f42318-462f-467b-82a0-10fb219ca5cc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.048018 May 16 15:31:23.327663 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 500/995] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:31:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 2049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:31:23.338172 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-58d66ef6-fef5-4cfb-95e8-f21119244118 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:23.338799 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-58d66ef6-fef5-4cfb-95e8-f21119244118 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:23.394675 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-58d66ef6-fef5-4cfb-95e8-f21119244118 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:23.401779 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-58d66ef6-fef5-4cfb-95e8-f21119244118 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1093 microversion: 2.1 time: 0.067950 May 16 15:31:23.402414 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 496/996] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:23 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:24.419187 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-a4e21078-6ada-4657-a46c-39e22ac8afdb tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:24.419965 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-a4e21078-6ada-4657-a46c-39e22ac8afdb tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:24.474372 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-a4e21078-6ada-4657-a46c-39e22ac8afdb tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:24.480860 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-a4e21078-6ada-4657-a46c-39e22ac8afdb tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1093 microversion: 2.1 time: 0.066306 May 16 15:31:24.481407 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 501/997] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:24 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:25.497692 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-664e7c09-f598-4c29-a772-fd4eda813efe tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:25.501710 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-664e7c09-f598-4c29-a772-fd4eda813efe tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:25.550087 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-664e7c09-f598-4c29-a772-fd4eda813efe tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:25.557190 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-664e7c09-f598-4c29-a772-fd4eda813efe tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1093 microversion: 2.1 time: 0.063350 May 16 15:31:25.557731 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 497/998] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:25 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:26.574199 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d35aabe6-4e5a-47e1-b735-9a7929d573b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:26.574812 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d35aabe6-4e5a-47e1-b735-9a7929d573b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:26.626047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d35aabe6-4e5a-47e1-b735-9a7929d573b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:26.633089 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d35aabe6-4e5a-47e1-b735-9a7929d573b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1093 microversion: 2.1 time: 0.062704 May 16 15:31:26.633634 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 502/999] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:26 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:27.649754 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e5bf658b-f7b5-4043-80db-3f2a82ef9c60 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:27.650311 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e5bf658b-f7b5-4043-80db-3f2a82ef9c60 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:27.656215 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5bf658b-f7b5-4043-80db-3f2a82ef9c60 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:27.656662 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5bf658b-f7b5-4043-80db-3f2a82ef9c60 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:27.657413 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5bf658b-f7b5-4043-80db-3f2a82ef9c60 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:27.657839 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e5bf658b-f7b5-4043-80db-3f2a82ef9c60 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:27.718027 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e5bf658b-f7b5-4043-80db-3f2a82ef9c60 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:27.725322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e5bf658b-f7b5-4043-80db-3f2a82ef9c60 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1143 microversion: 2.1 time: 0.079786 May 16 15:31:27.725878 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 498/1000] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:27 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:28.742000 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7eba5352-c765-4aa6-a7a2-2051a6b98809 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:28.742636 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7eba5352-c765-4aa6-a7a2-2051a6b98809 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:28.748995 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7eba5352-c765-4aa6-a7a2-2051a6b98809 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:28.749457 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7eba5352-c765-4aa6-a7a2-2051a6b98809 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:28.750271 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7eba5352-c765-4aa6-a7a2-2051a6b98809 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:28.750714 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-7eba5352-c765-4aa6-a7a2-2051a6b98809 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:28.813744 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7eba5352-c765-4aa6-a7a2-2051a6b98809 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:28.821198 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7eba5352-c765-4aa6-a7a2-2051a6b98809 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1135 microversion: 2.1 time: 0.083262 May 16 15:31:28.821762 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 503/1001] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:28 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1135 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:29.838078 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-cda7a55d-9538-48b9-9467-70907f486a8d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:29.839796 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-cda7a55d-9538-48b9-9467-70907f486a8d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:29.845376 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cda7a55d-9538-48b9-9467-70907f486a8d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:29.846238 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cda7a55d-9538-48b9-9467-70907f486a8d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:29.846613 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cda7a55d-9538-48b9-9467-70907f486a8d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:29.847057 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-cda7a55d-9538-48b9-9467-70907f486a8d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:29.921734 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-cda7a55d-9538-48b9-9467-70907f486a8d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:29.929542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-cda7a55d-9538-48b9-9467-70907f486a8d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1209 microversion: 2.1 time: 0.095311 May 16 15:31:29.930139 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 499/1002] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:29 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:30.946947 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-06864dc3-4a2d-4698-bda6-e92f6aa7e644 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:30.947551 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-06864dc3-4a2d-4698-bda6-e92f6aa7e644 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:30.954119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-06864dc3-4a2d-4698-bda6-e92f6aa7e644 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:30.954579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-06864dc3-4a2d-4698-bda6-e92f6aa7e644 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:30.955349 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-06864dc3-4a2d-4698-bda6-e92f6aa7e644 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:30.956038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-06864dc3-4a2d-4698-bda6-e92f6aa7e644 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:31.124083 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-7b9c137d-6eb7-4bac-89d3-81ceadb755af req-0c399f66-d001-4a84-ae14-19295e25171f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e6a25-7f99-47a1-bbcb-cdc660b97721", "tag": "82c85a8e-92bc-47c3-8de1-7d0fbeb7bca4"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:31.136164 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-7b9c137d-6eb7-4bac-89d3-81ceadb755af req-0c399f66-d001-4a84-ae14-19295e25171f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:31.136610 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-7b9c137d-6eb7-4bac-89d3-81ceadb755af req-0c399f66-d001-4a84-ae14-19295e25171f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:31.146886 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-06864dc3-4a2d-4698-bda6-e92f6aa7e644 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:31.150136 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-7b9c137d-6eb7-4bac-89d3-81ceadb755af req-0c399f66-d001-4a84-ae14-19295e25171f service nova] Creating event network-changed:82c85a8e-92bc-47c3-8de1-7d0fbeb7bca4 for instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 on hv-cinder-84175 May 16 15:31:31.156219 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-7b9c137d-6eb7-4bac-89d3-81ceadb755af req-0c399f66-d001-4a84-ae14-19295e25171f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042537 May 16 15:31:31.156405 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-06864dc3-4a2d-4698-bda6-e92f6aa7e644 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.213834 May 16 15:31:31.156822 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 500/1003] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:31.156991 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 504/1004] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:30 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:32.174826 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2f7c55cb-ce1d-4f94-be51-99e4a2483d5a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:32.175436 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2f7c55cb-ce1d-4f94-be51-99e4a2483d5a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:32.182246 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f7c55cb-ce1d-4f94-be51-99e4a2483d5a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:32.182691 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f7c55cb-ce1d-4f94-be51-99e4a2483d5a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:32.183456 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f7c55cb-ce1d-4f94-be51-99e4a2483d5a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:32.183910 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2f7c55cb-ce1d-4f94-be51-99e4a2483d5a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:32.311823 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2f7c55cb-ce1d-4f94-be51-99e4a2483d5a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:32.319508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2f7c55cb-ce1d-4f94-be51-99e4a2483d5a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.148973 May 16 15:31:32.320093 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 501/1005] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:32 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:33.336258 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-61a1949c-1831-4d55-a3c5-84fcb0fdf3ee tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:33.336867 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-61a1949c-1831-4d55-a3c5-84fcb0fdf3ee tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:33.343331 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-61a1949c-1831-4d55-a3c5-84fcb0fdf3ee tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:33.343839 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-61a1949c-1831-4d55-a3c5-84fcb0fdf3ee tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:33.344597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-61a1949c-1831-4d55-a3c5-84fcb0fdf3ee tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:33.345029 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-61a1949c-1831-4d55-a3c5-84fcb0fdf3ee tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:33.479342 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-61a1949c-1831-4d55-a3c5-84fcb0fdf3ee tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:33.486608 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-61a1949c-1831-4d55-a3c5-84fcb0fdf3ee tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.154291 May 16 15:31:33.487166 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 505/1006] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:33 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:34.503766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e45aac4d-08c8-4862-a89f-7233e5d99ed3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:34.504389 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e45aac4d-08c8-4862-a89f-7233e5d99ed3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:34.511419 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e45aac4d-08c8-4862-a89f-7233e5d99ed3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:34.511914 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e45aac4d-08c8-4862-a89f-7233e5d99ed3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:34.512685 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e45aac4d-08c8-4862-a89f-7233e5d99ed3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:34.513126 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e45aac4d-08c8-4862-a89f-7233e5d99ed3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:34.639752 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e45aac4d-08c8-4862-a89f-7233e5d99ed3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:34.647806 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e45aac4d-08c8-4862-a89f-7233e5d99ed3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.147919 May 16 15:31:34.648378 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 502/1007] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:34 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:35.664754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f9ad7c08-f02a-40b5-a109-5fe24fd051a2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:35.665361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f9ad7c08-f02a-40b5-a109-5fe24fd051a2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:35.671944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9ad7c08-f02a-40b5-a109-5fe24fd051a2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:35.672391 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9ad7c08-f02a-40b5-a109-5fe24fd051a2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:35.673150 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9ad7c08-f02a-40b5-a109-5fe24fd051a2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:35.673585 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f9ad7c08-f02a-40b5-a109-5fe24fd051a2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:35.803895 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f9ad7c08-f02a-40b5-a109-5fe24fd051a2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:35.811082 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f9ad7c08-f02a-40b5-a109-5fe24fd051a2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.150660 May 16 15:31:35.811668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 506/1008] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:35 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:36.827141 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-4055ef48-8772-4a40-9366-52e8ee3f6244 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:36.827801 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-4055ef48-8772-4a40-9366-52e8ee3f6244 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:36.835038 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4055ef48-8772-4a40-9366-52e8ee3f6244 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:36.842795 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4055ef48-8772-4a40-9366-52e8ee3f6244 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:36.842795 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4055ef48-8772-4a40-9366-52e8ee3f6244 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:36.842795 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-4055ef48-8772-4a40-9366-52e8ee3f6244 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:36.964712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-4055ef48-8772-4a40-9366-52e8ee3f6244 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:36.971863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-4055ef48-8772-4a40-9366-52e8ee3f6244 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.148575 May 16 15:31:36.972419 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 503/1009] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:36 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:37.991357 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-fed1a469-1fe4-454e-9dd0-580d91689f1b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:37.992003 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-fed1a469-1fe4-454e-9dd0-580d91689f1b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:37.998311 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fed1a469-1fe4-454e-9dd0-580d91689f1b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:37.998764 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fed1a469-1fe4-454e-9dd0-580d91689f1b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:37.999544 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fed1a469-1fe4-454e-9dd0-580d91689f1b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:38.000023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-fed1a469-1fe4-454e-9dd0-580d91689f1b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:38.127197 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-fed1a469-1fe4-454e-9dd0-580d91689f1b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:38.135152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-fed1a469-1fe4-454e-9dd0-580d91689f1b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.148954 May 16 15:31:38.135730 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 507/1010] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:37 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:39.153910 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-d959cc98-90bf-47de-aa2f-03c4aa2abcf8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:39.154457 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-d959cc98-90bf-47de-aa2f-03c4aa2abcf8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:39.160763 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d959cc98-90bf-47de-aa2f-03c4aa2abcf8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:39.161201 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d959cc98-90bf-47de-aa2f-03c4aa2abcf8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:39.162482 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d959cc98-90bf-47de-aa2f-03c4aa2abcf8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:39.162918 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-d959cc98-90bf-47de-aa2f-03c4aa2abcf8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:39.294586 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-d959cc98-90bf-47de-aa2f-03c4aa2abcf8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:39.301826 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-d959cc98-90bf-47de-aa2f-03c4aa2abcf8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.151797 May 16 15:31:39.303535 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 504/1011] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:39 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:40.320390 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2cd9e079-a5c9-4de3-be4b-f477f808e3d9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:40.321009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2cd9e079-a5c9-4de3-be4b-f477f808e3d9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:40.327668 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2cd9e079-a5c9-4de3-be4b-f477f808e3d9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:40.328176 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2cd9e079-a5c9-4de3-be4b-f477f808e3d9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:40.328943 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2cd9e079-a5c9-4de3-be4b-f477f808e3d9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:40.329381 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2cd9e079-a5c9-4de3-be4b-f477f808e3d9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:40.462206 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2cd9e079-a5c9-4de3-be4b-f477f808e3d9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:40.469486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2cd9e079-a5c9-4de3-be4b-f477f808e3d9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.153756 May 16 15:31:40.470038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 508/1012] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:40 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:41.486477 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2afc621b-27f7-4095-8d02-a9fa637ef993 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:41.487095 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2afc621b-27f7-4095-8d02-a9fa637ef993 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:41.494502 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2afc621b-27f7-4095-8d02-a9fa637ef993 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:41.494959 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2afc621b-27f7-4095-8d02-a9fa637ef993 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:41.495750 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2afc621b-27f7-4095-8d02-a9fa637ef993 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:41.496194 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2afc621b-27f7-4095-8d02-a9fa637ef993 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:41.625416 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2afc621b-27f7-4095-8d02-a9fa637ef993 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:41.632998 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2afc621b-27f7-4095-8d02-a9fa637ef993 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.150388 May 16 15:31:41.633562 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 505/1013] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:41 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:42.439967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-a3c4883a-232c-4499-9187-b2fc3fbbd449 req-88f758be-5f13-4dae-83b8-995c70d39a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e6a25-7f99-47a1-bbcb-cdc660b97721", "name": "network-vif-plugged", "status": "completed", "tag": "82c85a8e-92bc-47c3-8de1-7d0fbeb7bca4"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:42.449517 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-a3c4883a-232c-4499-9187-b2fc3fbbd449 req-88f758be-5f13-4dae-83b8-995c70d39a40 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:42.449968 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-a3c4883a-232c-4499-9187-b2fc3fbbd449 req-88f758be-5f13-4dae-83b8-995c70d39a40 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:42.461621 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-a3c4883a-232c-4499-9187-b2fc3fbbd449 req-88f758be-5f13-4dae-83b8-995c70d39a40 service nova] Creating event network-vif-plugged:82c85a8e-92bc-47c3-8de1-7d0fbeb7bca4 for instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 on hv-cinder-84175 May 16 15:31:42.466539 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-a3c4883a-232c-4499-9187-b2fc3fbbd449 req-88f758be-5f13-4dae-83b8-995c70d39a40 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030184 May 16 15:31:42.467107 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 509/1014] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:42.650275 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5d43b169-3f5f-4b5c-9476-6193ba27f199 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:42.650882 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5d43b169-3f5f-4b5c-9476-6193ba27f199 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:42.657181 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5d43b169-3f5f-4b5c-9476-6193ba27f199 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:42.660420 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5d43b169-3f5f-4b5c-9476-6193ba27f199 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:42.660420 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5d43b169-3f5f-4b5c-9476-6193ba27f199 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:42.660420 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5d43b169-3f5f-4b5c-9476-6193ba27f199 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:42.789895 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5d43b169-3f5f-4b5c-9476-6193ba27f199 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:42.797992 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5d43b169-3f5f-4b5c-9476-6193ba27f199 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.152033 May 16 15:31:42.798635 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 506/1015] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:42 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:43.815502 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-50e8c768-9dba-407e-b9ba-81df7dbf1758 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:43.816252 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-50e8c768-9dba-407e-b9ba-81df7dbf1758 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:43.822596 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-50e8c768-9dba-407e-b9ba-81df7dbf1758 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:43.828685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-50e8c768-9dba-407e-b9ba-81df7dbf1758 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:43.828685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-50e8c768-9dba-407e-b9ba-81df7dbf1758 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:43.828685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-50e8c768-9dba-407e-b9ba-81df7dbf1758 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:43.959463 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-50e8c768-9dba-407e-b9ba-81df7dbf1758 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:43.966737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-50e8c768-9dba-407e-b9ba-81df7dbf1758 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1265 microversion: 2.1 time: 0.155857 May 16 15:31:43.972017 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 510/1016] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:43 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:44.984081 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-56f89409-4a9c-4703-843d-a5d80cd80cff tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:44.984694 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-56f89409-4a9c-4703-843d-a5d80cd80cff tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:44.991056 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-56f89409-4a9c-4703-843d-a5d80cd80cff tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:44.991509 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-56f89409-4a9c-4703-843d-a5d80cd80cff tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:44.992299 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-56f89409-4a9c-4703-843d-a5d80cd80cff tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:44.992737 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-56f89409-4a9c-4703-843d-a5d80cd80cff tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:45.117960 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-56f89409-4a9c-4703-843d-a5d80cd80cff tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:45.125408 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-56f89409-4a9c-4703-843d-a5d80cd80cff tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1452 microversion: 2.1 time: 0.145190 May 16 15:31:45.125971 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 507/1017] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:44 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:45.141648 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b1cb48b9-4eb3-4c50-ba0c-fd1379a5f5c9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:45.142538 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b1cb48b9-4eb3-4c50-ba0c-fd1379a5f5c9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:45.149435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b1cb48b9-4eb3-4c50-ba0c-fd1379a5f5c9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:45.149875 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b1cb48b9-4eb3-4c50-ba0c-fd1379a5f5c9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:45.150630 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b1cb48b9-4eb3-4c50-ba0c-fd1379a5f5c9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:45.151061 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b1cb48b9-4eb3-4c50-ba0c-fd1379a5f5c9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:45.282525 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b1cb48b9-4eb3-4c50-ba0c-fd1379a5f5c9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:45.289984 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b1cb48b9-4eb3-4c50-ba0c-fd1379a5f5c9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1452 microversion: 2.1 time: 0.152025 May 16 15:31:45.290532 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 511/1018] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:31:45 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:47.340200 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-0ed4c4d8-939d-4f92-90f8-de624fa786eb req-e87f8aac-b2fd-4939-9419-ba95394da7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e6a25-7f99-47a1-bbcb-cdc660b97721", "tag": "82c85a8e-92bc-47c3-8de1-7d0fbeb7bca4"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:47.348129 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-0ed4c4d8-939d-4f92-90f8-de624fa786eb req-e87f8aac-b2fd-4939-9419-ba95394da7b4 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:47.348511 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-0ed4c4d8-939d-4f92-90f8-de624fa786eb req-e87f8aac-b2fd-4939-9419-ba95394da7b4 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:47.360161 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-0ed4c4d8-939d-4f92-90f8-de624fa786eb req-e87f8aac-b2fd-4939-9419-ba95394da7b4 service nova] Creating event network-changed:82c85a8e-92bc-47c3-8de1-7d0fbeb7bca4 for instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 on hv-cinder-84175 May 16 15:31:47.366094 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-0ed4c4d8-939d-4f92-90f8-de624fa786eb req-e87f8aac-b2fd-4939-9419-ba95394da7b4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083838 May 16 15:31:47.366913 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 508/1019] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:56.200498 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:31:56.201126 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Mon May 16 15:31:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:33:41.214011 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0071dbce-3f97-4079-89c5-655d699b6fe3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:41.214570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0071dbce-3f97-4079-89c5-655d699b6fe3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:41.220754 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0071dbce-3f97-4079-89c5-655d699b6fe3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:41.221204 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0071dbce-3f97-4079-89c5-655d699b6fe3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:41.222587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0071dbce-3f97-4079-89c5-655d699b6fe3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:41.223023 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0071dbce-3f97-4079-89c5-655d699b6fe3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:41.247793 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0071dbce-3f97-4079-89c5-655d699b6fe3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:33:41.506225 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0071dbce-3f97-4079-89c5-655d699b6fe3 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 204 len: 0 microversion: 2.1 time: 0.296541 May 16 15:33:41.506813 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 512/1020] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:33:41 2022] DELETE /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:33:41.513042 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b58ad50f-ee5c-443f-b5db-aa259e450404] AMQP server on 10.222.0.71:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 16 15:33:41.520762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b4e02c09-7e0d-440c-8dce-2d1bddb59450 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:41.520762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b4e02c09-7e0d-440c-8dce-2d1bddb59450 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:41.526002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b4e02c09-7e0d-440c-8dce-2d1bddb59450 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:41.526558 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b4e02c09-7e0d-440c-8dce-2d1bddb59450 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:41.527239 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b4e02c09-7e0d-440c-8dce-2d1bddb59450 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:41.527708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b4e02c09-7e0d-440c-8dce-2d1bddb59450 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:41.658210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b4e02c09-7e0d-440c-8dce-2d1bddb59450 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:41.666433 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b4e02c09-7e0d-440c-8dce-2d1bddb59450 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1577 microversion: 2.1 time: 0.155237 May 16 15:33:41.667000 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 509/1021] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:41 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:42.684413 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e2b8623c-4e45-4763-92e3-595cddb991e4 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:42.685035 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e2b8623c-4e45-4763-92e3-595cddb991e4 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:42.692905 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e2b8623c-4e45-4763-92e3-595cddb991e4 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:42.693357 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e2b8623c-4e45-4763-92e3-595cddb991e4 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:42.694475 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e2b8623c-4e45-4763-92e3-595cddb991e4 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:42.694909 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e2b8623c-4e45-4763-92e3-595cddb991e4 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:42.822578 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e2b8623c-4e45-4763-92e3-595cddb991e4 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:42.829894 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e2b8623c-4e45-4763-92e3-595cddb991e4 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1577 microversion: 2.1 time: 0.149855 May 16 15:33:42.830451 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 513/1022] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:42 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:43.848294 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-0bbc59fa-cf32-48b9-ba18-89f0c8d175f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:43.849020 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-0bbc59fa-cf32-48b9-ba18-89f0c8d175f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:43.856534 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0bbc59fa-cf32-48b9-ba18-89f0c8d175f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:43.856989 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0bbc59fa-cf32-48b9-ba18-89f0c8d175f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:43.857769 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0bbc59fa-cf32-48b9-ba18-89f0c8d175f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:43.858213 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-0bbc59fa-cf32-48b9-ba18-89f0c8d175f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:43.874712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [-] [b58ad50f-ee5c-443f-b5db-aa259e450404] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 34892. May 16 15:33:44.026510 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-0bbc59fa-cf32-48b9-ba18-89f0c8d175f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:44.033758 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-0bbc59fa-cf32-48b9-ba18-89f0c8d175f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1577 microversion: 2.1 time: 0.190307 May 16 15:33:44.034945 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 510/1023] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:43 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:44.436694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-588f6357-af00-4e29-a36a-aa047df57956 req-78d7bef3-af03-4f7d-8ae9-d1c24c19c11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e6a25-7f99-47a1-bbcb-cdc660b97721", "name": "network-vif-deleted", "tag": "82c85a8e-92bc-47c3-8de1-7d0fbeb7bca4"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:44.447839 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-588f6357-af00-4e29-a36a-aa047df57956 req-78d7bef3-af03-4f7d-8ae9-d1c24c19c11c service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:44.448291 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-588f6357-af00-4e29-a36a-aa047df57956 req-78d7bef3-af03-4f7d-8ae9-d1c24c19c11c service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:44.461289 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-588f6357-af00-4e29-a36a-aa047df57956 req-78d7bef3-af03-4f7d-8ae9-d1c24c19c11c service nova] Creating event network-vif-deleted:82c85a8e-92bc-47c3-8de1-7d0fbeb7bca4 for instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 on hv-cinder-84175 May 16 15:33:44.466307 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-588f6357-af00-4e29-a36a-aa047df57956 req-78d7bef3-af03-4f7d-8ae9-d1c24c19c11c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108296 May 16 15:33:44.466956 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 514/1024] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:33:45.050985 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:45.051661 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:45.058252 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:45.058705 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:45.059483 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:45.059954 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:45.094377 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:45.094745 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:45.095244 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lazy-loading 'fault' on Instance uuid e65e6a25-7f99-47a1-bbcb-cdc660b97721 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:33:45.142717 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:45.151083 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-ee02d2fb-323b-4077-a2f0-90e0b2da8595 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 200 len: 1229 microversion: 2.1 time: 0.104596 May 16 15:33:45.151708 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 511/1025] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:45 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:46.169095 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:46.169710 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:46.177226 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:46.177674 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:46.178442 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:46.178878 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:46.192399 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] HTTP exception thrown: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Request method failure captured: May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 HTTP/1.1 May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigm4w5dWjXZwZ8tt77b9l5vmmjI-WnLBf3G8z-U_LGyMzX7N3GbsczecthfRHPwtlfwsnwb30i8Ms1GkRQsIai7OwXPtxEJCg5hQKPip0jRactLuDZI6JuT85I_7RNt3AwD6FaNfBNRP7yLWP407mpAbhtfIOv1ZJ2OTZqUpGS5x6qeI May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 35be16de8a104d569efbb5633c5036af May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:33:46.193981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/35be16de8a104d569efbb5633c5036af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_35be16de8a104d569efbb5633c5036af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}] May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-TestVolumeBootPattern-1823841486 May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 35be16de8a104d569efbb5633c5036af May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-TestVolumeBootPattern-1823841486-project May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 1f3e4b15a6cc4879b24d7a44669a3690 May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-TestVolumeBootPattern-1823841486-project May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:33:46.195595 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'e65e6a25-7f99-47a1-bbcb-cdc660b97721'} May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:46.196570 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:33:46.198172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:33:46.199575 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Returning 404 to user: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:46.199575 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b1c43eea-4748-41b1-b18d-db2ffa642110 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 404 len: 111 microversion: 2.1 time: 0.030873 May 16 15:33:46.199575 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 515/1026] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:46 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:46.241293 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-694956668", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-357988655", "security_groups": [{"name": "tempest-secgroup-smoke-2082613032"}], "block_device_mapping_v2": [{"uuid": "235f10b5-1005-4566-92ca-0d4c96707403", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e5b8e9b-f5ed-471c-99f0-3d6ef4d85cce"}]}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:46.350800 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] validate_networks() for [('9e5b8e9b-f5ed-471c-99f0-3d6ef4d85cce', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:33:46.480145 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:33:46.480344 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Mon May 16 15:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.71) !!! May 16 15:33:46.711353 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:33:46.711818 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:33:46.712292 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:33:46.712697 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:33:46.713119 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:33:46.723080 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:46.723520 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:46.724330 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:46.724761 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:46.741212 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Getting quotas for project 35be16de8a104d569efbb5633c5036af. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:33:46.745183 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Getting quotas for user 1f3e4b15a6cc4879b24d7a44669a3690 and project 35be16de8a104d569efbb5633c5036af. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:33:46.801424 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:33:46.803566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='235f10b5-1005-4566-92ca-0d4c96707403',volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:33:47.166102 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e1e3520d-a83e-4639-90db-73adf829832a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.929543 May 16 15:33:47.166820 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 512/1027] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:33:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 15:33:47.177475 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2d36f0b2-4b43-4942-8b51-16491bd31bd1 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:47.178213 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2d36f0b2-4b43-4942-8b51-16491bd31bd1 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:47.232904 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2d36f0b2-4b43-4942-8b51-16491bd31bd1 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:47.240769 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2d36f0b2-4b43-4942-8b51-16491bd31bd1 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1093 microversion: 2.1 time: 0.067751 May 16 15:33:47.241350 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 516/1028] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:47 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:48.258281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-74268f4c-23b8-4180-9868-2a7bad36e75c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:48.258896 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-74268f4c-23b8-4180-9868-2a7bad36e75c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:48.264978 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-74268f4c-23b8-4180-9868-2a7bad36e75c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:48.270530 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-74268f4c-23b8-4180-9868-2a7bad36e75c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:48.270530 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-74268f4c-23b8-4180-9868-2a7bad36e75c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:48.270530 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-74268f4c-23b8-4180-9868-2a7bad36e75c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:48.330390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-74268f4c-23b8-4180-9868-2a7bad36e75c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:48.338088 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-74268f4c-23b8-4180-9868-2a7bad36e75c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1143 microversion: 2.1 time: 0.084183 May 16 15:33:48.338660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 513/1029] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:48 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:49.354363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-0eb656c8-9557-45bc-aac5-84ab5ed7a686 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:49.355022 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-0eb656c8-9557-45bc-aac5-84ab5ed7a686 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:49.362022 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0eb656c8-9557-45bc-aac5-84ab5ed7a686 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:49.362471 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0eb656c8-9557-45bc-aac5-84ab5ed7a686 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:49.363445 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0eb656c8-9557-45bc-aac5-84ab5ed7a686 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:49.364070 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-0eb656c8-9557-45bc-aac5-84ab5ed7a686 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:49.437447 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-0eb656c8-9557-45bc-aac5-84ab5ed7a686 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:49.444897 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-0eb656c8-9557-45bc-aac5-84ab5ed7a686 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1199 microversion: 2.1 time: 0.094557 May 16 15:33:49.445450 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 517/1030] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:49 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:50.467859 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5b69f9e0-3f54-41d9-94b1-de85aabdbb5c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:50.468421 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5b69f9e0-3f54-41d9-94b1-de85aabdbb5c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:50.474728 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5b69f9e0-3f54-41d9-94b1-de85aabdbb5c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:50.475177 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5b69f9e0-3f54-41d9-94b1-de85aabdbb5c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:50.476007 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5b69f9e0-3f54-41d9-94b1-de85aabdbb5c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:50.476633 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5b69f9e0-3f54-41d9-94b1-de85aabdbb5c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:50.677689 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5b69f9e0-3f54-41d9-94b1-de85aabdbb5c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:50.684921 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5b69f9e0-3f54-41d9-94b1-de85aabdbb5c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1277 microversion: 2.1 time: 0.221122 May 16 15:33:50.685488 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 514/1031] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:50 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:33:50.852789 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:33:50.853223 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Mon May 16 15:33:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:33:51.147966 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-522b983d-c5e5-4a80-bf1a-ad02fb64252a req-3eec4b51-fc7e-4ce6-95fe-8d94737bde59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1", "tag": "b8b5421f-ded5-4aa6-b059-4ba9b102a4af"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:51.157328 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-522b983d-c5e5-4a80-bf1a-ad02fb64252a req-3eec4b51-fc7e-4ce6-95fe-8d94737bde59 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:51.158062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-522b983d-c5e5-4a80-bf1a-ad02fb64252a req-3eec4b51-fc7e-4ce6-95fe-8d94737bde59 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:51.172099 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-522b983d-c5e5-4a80-bf1a-ad02fb64252a req-3eec4b51-fc7e-4ce6-95fe-8d94737bde59 service nova] Creating event network-changed:b8b5421f-ded5-4aa6-b059-4ba9b102a4af for instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 on hv-cinder-84175 May 16 15:33:51.180155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-522b983d-c5e5-4a80-bf1a-ad02fb64252a req-3eec4b51-fc7e-4ce6-95fe-8d94737bde59 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036084 May 16 15:33:51.180155 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 518/1032] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:33:51.702322 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1f9659b2-aeb4-4780-8207-d33dc56b6bc9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:51.702938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1f9659b2-aeb4-4780-8207-d33dc56b6bc9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:51.709552 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1f9659b2-aeb4-4780-8207-d33dc56b6bc9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:51.710002 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1f9659b2-aeb4-4780-8207-d33dc56b6bc9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:51.710776 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1f9659b2-aeb4-4780-8207-d33dc56b6bc9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:51.711210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1f9659b2-aeb4-4780-8207-d33dc56b6bc9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:51.923939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1f9659b2-aeb4-4780-8207-d33dc56b6bc9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:51.932410 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1f9659b2-aeb4-4780-8207-d33dc56b6bc9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.233992 May 16 15:33:51.932982 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 515/1033] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:51 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:52.950405 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-d9f29638-782b-4cac-814b-d358d22cd03a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:52.951102 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-d9f29638-782b-4cac-814b-d358d22cd03a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:52.957742 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d9f29638-782b-4cac-814b-d358d22cd03a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:52.958181 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d9f29638-782b-4cac-814b-d358d22cd03a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:52.958935 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d9f29638-782b-4cac-814b-d358d22cd03a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:52.959361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-d9f29638-782b-4cac-814b-d358d22cd03a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:53.086056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-d9f29638-782b-4cac-814b-d358d22cd03a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:53.093323 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-d9f29638-782b-4cac-814b-d358d22cd03a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.147585 May 16 15:33:53.093888 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 519/1034] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:52 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:54.109592 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-53ce3d44-3d29-49c0-9ffa-220abbd9a8a7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:54.110175 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-53ce3d44-3d29-49c0-9ffa-220abbd9a8a7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:54.117129 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-53ce3d44-3d29-49c0-9ffa-220abbd9a8a7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:54.117576 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-53ce3d44-3d29-49c0-9ffa-220abbd9a8a7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:54.118334 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-53ce3d44-3d29-49c0-9ffa-220abbd9a8a7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:54.118765 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-53ce3d44-3d29-49c0-9ffa-220abbd9a8a7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:54.246279 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-53ce3d44-3d29-49c0-9ffa-220abbd9a8a7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:54.253572 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-53ce3d44-3d29-49c0-9ffa-220abbd9a8a7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.147872 May 16 15:33:54.254130 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 516/1035] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:54 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:55.270499 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-37cbfdca-1c13-4ef8-bf13-e1eed231d7f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:55.271110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-37cbfdca-1c13-4ef8-bf13-e1eed231d7f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:55.277597 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-37cbfdca-1c13-4ef8-bf13-e1eed231d7f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:55.278046 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-37cbfdca-1c13-4ef8-bf13-e1eed231d7f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:55.278805 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-37cbfdca-1c13-4ef8-bf13-e1eed231d7f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:55.279237 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-37cbfdca-1c13-4ef8-bf13-e1eed231d7f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:55.460679 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-37cbfdca-1c13-4ef8-bf13-e1eed231d7f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:55.468056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-37cbfdca-1c13-4ef8-bf13-e1eed231d7f8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.201583 May 16 15:33:55.468610 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 520/1036] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:55 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:56.484780 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-e429ee6b-2b05-4980-9402-304a11e38ee8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:56.485398 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-e429ee6b-2b05-4980-9402-304a11e38ee8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:56.492100 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e429ee6b-2b05-4980-9402-304a11e38ee8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:56.492551 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e429ee6b-2b05-4980-9402-304a11e38ee8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:56.493318 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e429ee6b-2b05-4980-9402-304a11e38ee8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:56.493753 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-e429ee6b-2b05-4980-9402-304a11e38ee8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:56.618565 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-e429ee6b-2b05-4980-9402-304a11e38ee8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:56.625840 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-e429ee6b-2b05-4980-9402-304a11e38ee8 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.144962 May 16 15:33:56.626402 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 517/1037] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:56 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:57.642503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-642d7bb6-3b65-42a2-bffc-e9184111914f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:57.643114 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-642d7bb6-3b65-42a2-bffc-e9184111914f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:57.649372 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-642d7bb6-3b65-42a2-bffc-e9184111914f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:57.649817 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-642d7bb6-3b65-42a2-bffc-e9184111914f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:57.650574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-642d7bb6-3b65-42a2-bffc-e9184111914f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:57.651009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-642d7bb6-3b65-42a2-bffc-e9184111914f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:57.780382 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-642d7bb6-3b65-42a2-bffc-e9184111914f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:57.788297 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-642d7bb6-3b65-42a2-bffc-e9184111914f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.149872 May 16 15:33:57.788858 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 521/1038] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:57 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:58.805630 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1e09e26d-aa26-4a51-a841-999ce647af5b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:58.806280 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1e09e26d-aa26-4a51-a841-999ce647af5b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:58.812641 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1e09e26d-aa26-4a51-a841-999ce647af5b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:58.813092 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1e09e26d-aa26-4a51-a841-999ce647af5b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:58.813863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1e09e26d-aa26-4a51-a841-999ce647af5b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:58.814306 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1e09e26d-aa26-4a51-a841-999ce647af5b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:58.951842 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1e09e26d-aa26-4a51-a841-999ce647af5b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:58.954833 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1e09e26d-aa26-4a51-a841-999ce647af5b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.153757 May 16 15:33:58.955401 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 518/1039] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:58 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:59.971562 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-f1cde9a6-256e-45a1-a0a3-8cc208021c88 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:59.972212 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-f1cde9a6-256e-45a1-a0a3-8cc208021c88 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:59.978806 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f1cde9a6-256e-45a1-a0a3-8cc208021c88 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:59.979256 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f1cde9a6-256e-45a1-a0a3-8cc208021c88 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:59.980052 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f1cde9a6-256e-45a1-a0a3-8cc208021c88 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:59.980494 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-f1cde9a6-256e-45a1-a0a3-8cc208021c88 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:00.111362 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-f1cde9a6-256e-45a1-a0a3-8cc208021c88 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:34:00.119404 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-f1cde9a6-256e-45a1-a0a3-8cc208021c88 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.151669 May 16 15:34:00.119981 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 522/1040] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:33:59 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:34:01.051270 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-62deea0e-9318-41f3-9a47-b82b103bd564 req-458637f7-15d1-4be2-b81c-834e989689d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1", "name": "network-vif-plugged", "status": "completed", "tag": "b8b5421f-ded5-4aa6-b059-4ba9b102a4af"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:34:01.059857 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-62deea0e-9318-41f3-9a47-b82b103bd564 req-458637f7-15d1-4be2-b81c-834e989689d2 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:01.060301 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-62deea0e-9318-41f3-9a47-b82b103bd564 req-458637f7-15d1-4be2-b81c-834e989689d2 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:01.071534 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-62deea0e-9318-41f3-9a47-b82b103bd564 req-458637f7-15d1-4be2-b81c-834e989689d2 service nova] Creating event network-vif-plugged:b8b5421f-ded5-4aa6-b059-4ba9b102a4af for instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 on hv-cinder-84175 May 16 15:34:01.077398 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-62deea0e-9318-41f3-9a47-b82b103bd564 req-458637f7-15d1-4be2-b81c-834e989689d2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090743 May 16 15:34:01.080569 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 519/1041] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:34:01.136983 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-6864957c-2916-42d0-a8ed-0c0c383c794c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:34:01.137630 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-6864957c-2916-42d0-a8ed-0c0c383c794c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:34:01.146644 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6864957c-2916-42d0-a8ed-0c0c383c794c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:01.149287 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6864957c-2916-42d0-a8ed-0c0c383c794c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:01.149287 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6864957c-2916-42d0-a8ed-0c0c383c794c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:01.149287 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-6864957c-2916-42d0-a8ed-0c0c383c794c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:01.297111 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-6864957c-2916-42d0-a8ed-0c0c383c794c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:34:01.307451 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-6864957c-2916-42d0-a8ed-0c0c383c794c tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.174921 May 16 15:34:01.308044 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 523/1042] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:34:01 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:34:02.324951 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2b0c486f-eff1-460e-b83e-96f50d14f8c2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:34:02.325643 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2b0c486f-eff1-460e-b83e-96f50d14f8c2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:34:02.331766 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2b0c486f-eff1-460e-b83e-96f50d14f8c2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:02.332210 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2b0c486f-eff1-460e-b83e-96f50d14f8c2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:02.333674 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2b0c486f-eff1-460e-b83e-96f50d14f8c2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:02.334199 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2b0c486f-eff1-460e-b83e-96f50d14f8c2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:02.467953 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-2b0c486f-eff1-460e-b83e-96f50d14f8c2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:34:02.476443 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2b0c486f-eff1-460e-b83e-96f50d14f8c2 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1265 microversion: 2.1 time: 0.155995 May 16 15:34:02.480430 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 520/1043] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:34:02 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:34:03.493603 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-764e16ad-e93d-4825-9754-04e1ac4eeb65 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:34:03.494188 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-764e16ad-e93d-4825-9754-04e1ac4eeb65 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:34:03.500543 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-764e16ad-e93d-4825-9754-04e1ac4eeb65 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:03.501123 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-764e16ad-e93d-4825-9754-04e1ac4eeb65 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:03.501737 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-764e16ad-e93d-4825-9754-04e1ac4eeb65 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:03.502166 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-764e16ad-e93d-4825-9754-04e1ac4eeb65 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:03.632184 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-764e16ad-e93d-4825-9754-04e1ac4eeb65 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:34:03.639458 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-764e16ad-e93d-4825-9754-04e1ac4eeb65 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1452 microversion: 2.1 time: 0.149742 May 16 15:34:03.640038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 524/1044] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:34:03 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:34:03.656040 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-3e85aa29-e2c0-4392-b8bd-ca3138a78472 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:34:03.658120 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-3e85aa29-e2c0-4392-b8bd-ca3138a78472 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:34:03.663489 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3e85aa29-e2c0-4392-b8bd-ca3138a78472 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:03.663965 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3e85aa29-e2c0-4392-b8bd-ca3138a78472 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:03.664729 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3e85aa29-e2c0-4392-b8bd-ca3138a78472 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:03.665162 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-3e85aa29-e2c0-4392-b8bd-ca3138a78472 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:03.796253 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-3e85aa29-e2c0-4392-b8bd-ca3138a78472 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:34:03.803939 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-3e85aa29-e2c0-4392-b8bd-ca3138a78472 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1452 microversion: 2.1 time: 0.151665 May 16 15:34:03.804515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 521/1045] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:34:03 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:34:05.849817 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-48461b62-91c6-4396-8a21-73cb75f27b99 req-8e5170f6-df0b-40b5-bd44-3a5cdf9c20fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1", "tag": "b8b5421f-ded5-4aa6-b059-4ba9b102a4af"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:34:05.858071 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-48461b62-91c6-4396-8a21-73cb75f27b99 req-8e5170f6-df0b-40b5-bd44-3a5cdf9c20fa service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:34:05.865236 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-48461b62-91c6-4396-8a21-73cb75f27b99 req-8e5170f6-df0b-40b5-bd44-3a5cdf9c20fa service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:34:05.870288 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-48461b62-91c6-4396-8a21-73cb75f27b99 req-8e5170f6-df0b-40b5-bd44-3a5cdf9c20fa service nova] Creating event network-changed:b8b5421f-ded5-4aa6-b059-4ba9b102a4af for instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 on hv-cinder-84175 May 16 15:34:05.875503 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-48461b62-91c6-4396-8a21-73cb75f27b99 req-8e5170f6-df0b-40b5-bd44-3a5cdf9c20fa service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030075 May 16 15:34:05.876133 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 525/1046] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:35:52.909515 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-328987576", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-357988655", "security_groups": [{"name": "tempest-secgroup-smoke-2082613032"}], "block_device_mapping_v2": [{"uuid": "3690ecad-3379-46fa-907c-49aae6d662da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e5b8e9b-f5ed-471c-99f0-3d6ef4d85cce"}]}} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:35:53.140566 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.network.neutron [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] validate_networks() for [('9e5b8e9b-f5ed-471c-99f0-3d6ef4d85cce', None, None, None, None, None)] {{(pid=117677) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:35:53.540285 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Flavor limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:35:53.540285 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Image limits 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:35:53.540599 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Flavor pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:35:53.540839 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Image pref 0:0:0 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:35:53.541255 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.virt.hardware [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:35:53.549843 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:53.550342 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:53.551146 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:53.551622 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:53.568660 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Getting quotas for project 35be16de8a104d569efbb5633c5036af. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:35:53.572524 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.quota [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Getting quotas for user 1f3e4b15a6cc4879b24d7a44669a3690 and project 35be16de8a104d569efbb5633c5036af. Resources: {'instances', 'cores', 'ram'} {{(pid=117677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:35:53.628573 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Going to run 1 instances... {{(pid=117677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:35:53.630795 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3690ecad-3379-46fa-907c-49aae6d662da',volume_size=None,volume_type=None)] {{(pid=117677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:35:54.061224 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5a874b85-636c-43e0-a132-9224bd3aa8ca tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.155885 May 16 15:35:54.062170 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 522/1047] 10.222.0.71 () {60 vars in 1146 bytes} [Mon May 16 15:35:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:35:54.069967 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6f046a5-460d-403f-8077-f1c9b9c0d285] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 15:35:54.074251 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-7011cc61-27aa-4cdd-99de-10b69e3ee29b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:54.075071 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-7011cc61-27aa-4cdd-99de-10b69e3ee29b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:54.182241 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-7011cc61-27aa-4cdd-99de-10b69e3ee29b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:54.189559 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-7011cc61-27aa-4cdd-99de-10b69e3ee29b tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1093 microversion: 2.1 time: 0.121401 May 16 15:35:54.190135 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 526/1048] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:35:54 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1093 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:55.206915 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7ca840bd-52bf-4725-9dcb-d759f1e31f67 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:55.207533 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7ca840bd-52bf-4725-9dcb-d759f1e31f67 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:55.213491 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7ca840bd-52bf-4725-9dcb-d759f1e31f67 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:55.213940 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7ca840bd-52bf-4725-9dcb-d759f1e31f67 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:55.214703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7ca840bd-52bf-4725-9dcb-d759f1e31f67 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:55.215138 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7ca840bd-52bf-4725-9dcb-d759f1e31f67 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:55.276759 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7ca840bd-52bf-4725-9dcb-d759f1e31f67 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:55.284297 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7ca840bd-52bf-4725-9dcb-d759f1e31f67 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1135 microversion: 2.1 time: 0.081770 May 16 15:35:55.284863 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 523/1049] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:35:55 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1135 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:56.301846 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-534a19d5-a8f9-4967-b148-b96ceadc2e32 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:56.303133 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-534a19d5-a8f9-4967-b148-b96ceadc2e32 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:56.311735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-534a19d5-a8f9-4967-b148-b96ceadc2e32 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:56.312189 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-534a19d5-a8f9-4967-b148-b96ceadc2e32 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:56.312997 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-534a19d5-a8f9-4967-b148-b96ceadc2e32 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:56.313435 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-534a19d5-a8f9-4967-b148-b96ceadc2e32 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:56.334655 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6f046a5-460d-403f-8077-f1c9b9c0d285] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 35074. May 16 15:35:56.385673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-534a19d5-a8f9-4967-b148-b96ceadc2e32 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:56.393976 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-534a19d5-a8f9-4967-b148-b96ceadc2e32 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1209 microversion: 2.1 time: 0.096003 May 16 15:35:56.394546 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 527/1050] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:35:56 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:57.413938 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-49bd4e7a-4aaf-4b80-b03d-bf47c28ddd1d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:57.414996 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-49bd4e7a-4aaf-4b80-b03d-bf47c28ddd1d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:57.426557 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-49bd4e7a-4aaf-4b80-b03d-bf47c28ddd1d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:57.427043 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-49bd4e7a-4aaf-4b80-b03d-bf47c28ddd1d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:57.427855 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-49bd4e7a-4aaf-4b80-b03d-bf47c28ddd1d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:57.428291 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-49bd4e7a-4aaf-4b80-b03d-bf47c28ddd1d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:57.613821 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-49bd4e7a-4aaf-4b80-b03d-bf47c28ddd1d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:57.621400 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-49bd4e7a-4aaf-4b80-b03d-bf47c28ddd1d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.214568 May 16 15:35:57.622390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 524/1051] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:35:57 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:57.795056 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-27719c7a-00cc-480a-9f6d-56ef73c3a51b req-bd7c3d23-f29c-40e4-be0b-b4f98389d142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117ef420-3f60-461e-940a-e7a9a4e85824", "tag": "a5054d8a-54b7-4c5d-bf2b-6bf5e2980688"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:35:57.809735 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-27719c7a-00cc-480a-9f6d-56ef73c3a51b req-bd7c3d23-f29c-40e4-be0b-b4f98389d142 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:57.810131 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-27719c7a-00cc-480a-9f6d-56ef73c3a51b req-bd7c3d23-f29c-40e4-be0b-b4f98389d142 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:57.822811 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-27719c7a-00cc-480a-9f6d-56ef73c3a51b req-bd7c3d23-f29c-40e4-be0b-b4f98389d142 service nova] Creating event network-changed:a5054d8a-54b7-4c5d-bf2b-6bf5e2980688 for instance 117ef420-3f60-461e-940a-e7a9a4e85824 on hv-cinder-84175 May 16 15:35:57.828740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-27719c7a-00cc-480a-9f6d-56ef73c3a51b req-bd7c3d23-f29c-40e4-be0b-b4f98389d142 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040163 May 16 15:35:57.829330 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 528/1052] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:35:58.638312 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-5a8940c4-9ccc-40ed-8dca-60790be548d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:58.639963 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-5a8940c4-9ccc-40ed-8dca-60790be548d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:58.646610 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a8940c4-9ccc-40ed-8dca-60790be548d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:58.647058 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a8940c4-9ccc-40ed-8dca-60790be548d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:58.647923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a8940c4-9ccc-40ed-8dca-60790be548d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:58.648364 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-5a8940c4-9ccc-40ed-8dca-60790be548d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:58.783800 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-5a8940c4-9ccc-40ed-8dca-60790be548d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:58.791245 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-5a8940c4-9ccc-40ed-8dca-60790be548d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.156866 May 16 15:35:58.791836 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 525/1053] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:35:58 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:59.809248 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-25b6bef1-0c5d-4ba6-a23a-af91836a7afa tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:59.809971 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-25b6bef1-0c5d-4ba6-a23a-af91836a7afa tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:59.817117 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25b6bef1-0c5d-4ba6-a23a-af91836a7afa tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:59.817547 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25b6bef1-0c5d-4ba6-a23a-af91836a7afa tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:59.818327 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25b6bef1-0c5d-4ba6-a23a-af91836a7afa tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:59.818758 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-25b6bef1-0c5d-4ba6-a23a-af91836a7afa tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:59.949678 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-25b6bef1-0c5d-4ba6-a23a-af91836a7afa tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:59.957169 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-25b6bef1-0c5d-4ba6-a23a-af91836a7afa tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.152462 May 16 15:35:59.957752 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 529/1054] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:35:59 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:00.974238 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-71f30ce1-0352-4e6a-b65e-14cb41fba87f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:00.974853 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-71f30ce1-0352-4e6a-b65e-14cb41fba87f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:00.981164 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-71f30ce1-0352-4e6a-b65e-14cb41fba87f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:00.981608 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-71f30ce1-0352-4e6a-b65e-14cb41fba87f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:00.982436 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-71f30ce1-0352-4e6a-b65e-14cb41fba87f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:00.982889 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-71f30ce1-0352-4e6a-b65e-14cb41fba87f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:01.106712 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-71f30ce1-0352-4e6a-b65e-14cb41fba87f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:01.114801 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-71f30ce1-0352-4e6a-b65e-14cb41fba87f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.144439 May 16 15:36:01.115354 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 526/1055] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:00 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:02.131479 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-76f94f6b-da48-4a96-a124-19717477bb30 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:02.132047 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-76f94f6b-da48-4a96-a124-19717477bb30 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:02.138368 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-76f94f6b-da48-4a96-a124-19717477bb30 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:02.139336 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-76f94f6b-da48-4a96-a124-19717477bb30 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:02.140141 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-76f94f6b-da48-4a96-a124-19717477bb30 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:02.140579 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-76f94f6b-da48-4a96-a124-19717477bb30 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:02.269361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-76f94f6b-da48-4a96-a124-19717477bb30 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:02.276598 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-76f94f6b-da48-4a96-a124-19717477bb30 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.149037 May 16 15:36:02.277152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 530/1056] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:02 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:03.340154 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-392c4a99-63d5-4f83-bee7-db928580e70e tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:03.340806 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-392c4a99-63d5-4f83-bee7-db928580e70e tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:03.347200 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-392c4a99-63d5-4f83-bee7-db928580e70e tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:03.347682 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-392c4a99-63d5-4f83-bee7-db928580e70e tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:03.348457 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-392c4a99-63d5-4f83-bee7-db928580e70e tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:03.348895 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-392c4a99-63d5-4f83-bee7-db928580e70e tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:03.479555 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-392c4a99-63d5-4f83-bee7-db928580e70e tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:03.487469 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-392c4a99-63d5-4f83-bee7-db928580e70e tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.197647 May 16 15:36:03.488032 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 527/1057] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:03 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:04.504440 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-550569fa-399a-4ea4-b53a-bbb9dc3894df tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:04.505038 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-550569fa-399a-4ea4-b53a-bbb9dc3894df tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:04.511434 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-550569fa-399a-4ea4-b53a-bbb9dc3894df tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:04.511907 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-550569fa-399a-4ea4-b53a-bbb9dc3894df tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:04.512673 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-550569fa-399a-4ea4-b53a-bbb9dc3894df tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:04.513105 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-550569fa-399a-4ea4-b53a-bbb9dc3894df tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:04.678011 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-550569fa-399a-4ea4-b53a-bbb9dc3894df tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:04.685292 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-550569fa-399a-4ea4-b53a-bbb9dc3894df tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.184943 May 16 15:36:04.686542 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 531/1058] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:04 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:05.702592 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-431b65cd-0052-4b07-a742-2a594e272c75 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:05.703222 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-431b65cd-0052-4b07-a742-2a594e272c75 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:05.711390 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-431b65cd-0052-4b07-a742-2a594e272c75 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:05.719508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-431b65cd-0052-4b07-a742-2a594e272c75 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:05.719508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-431b65cd-0052-4b07-a742-2a594e272c75 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:05.719508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-431b65cd-0052-4b07-a742-2a594e272c75 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:05.845281 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-431b65cd-0052-4b07-a742-2a594e272c75 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:05.852620 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-431b65cd-0052-4b07-a742-2a594e272c75 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.154221 May 16 15:36:05.853181 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 528/1059] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:05 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:06.870126 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-e3b62987-4174-4643-8947-58a7497a6763 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:06.870765 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-e3b62987-4174-4643-8947-58a7497a6763 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:06.877361 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3b62987-4174-4643-8947-58a7497a6763 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:06.877807 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3b62987-4174-4643-8947-58a7497a6763 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:06.878574 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3b62987-4174-4643-8947-58a7497a6763 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:06.879009 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-e3b62987-4174-4643-8947-58a7497a6763 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:07.010531 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-e3b62987-4174-4643-8947-58a7497a6763 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:07.018899 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-e3b62987-4174-4643-8947-58a7497a6763 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.152596 May 16 15:36:07.019441 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 532/1060] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:06 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:07.599026 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-288c3376-98a7-49de-b2da-3ba3d41ebd89 req-4216fc1f-6fbe-4d72-972e-42f942c2a577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117ef420-3f60-461e-940a-e7a9a4e85824", "name": "network-vif-plugged", "status": "completed", "tag": "a5054d8a-54b7-4c5d-bf2b-6bf5e2980688"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:36:07.607815 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-288c3376-98a7-49de-b2da-3ba3d41ebd89 req-4216fc1f-6fbe-4d72-972e-42f942c2a577 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:07.608182 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-288c3376-98a7-49de-b2da-3ba3d41ebd89 req-4216fc1f-6fbe-4d72-972e-42f942c2a577 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:07.619532 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-288c3376-98a7-49de-b2da-3ba3d41ebd89 req-4216fc1f-6fbe-4d72-972e-42f942c2a577 service nova] Creating event network-vif-plugged:a5054d8a-54b7-4c5d-bf2b-6bf5e2980688 for instance 117ef420-3f60-461e-940a-e7a9a4e85824 on hv-cinder-84175 May 16 15:36:07.624522 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-288c3376-98a7-49de-b2da-3ba3d41ebd89 req-4216fc1f-6fbe-4d72-972e-42f942c2a577 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029173 May 16 15:36:07.626124 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 529/1061] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:36:08.035363 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-af6fd62a-b3f1-4799-826b-736285aa462f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:08.036014 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-af6fd62a-b3f1-4799-826b-736285aa462f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:08.042147 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-af6fd62a-b3f1-4799-826b-736285aa462f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:08.042605 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-af6fd62a-b3f1-4799-826b-736285aa462f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:08.043388 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-af6fd62a-b3f1-4799-826b-736285aa462f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:08.043866 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-af6fd62a-b3f1-4799-826b-736285aa462f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:08.171434 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-af6fd62a-b3f1-4799-826b-736285aa462f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:08.178920 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-af6fd62a-b3f1-4799-826b-736285aa462f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1265 microversion: 2.1 time: 0.147403 May 16 15:36:08.179482 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 533/1062] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:08 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:09.196825 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-b366d655-095a-46b0-97dd-e5a7e4996345 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:09.197447 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-b366d655-095a-46b0-97dd-e5a7e4996345 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:09.204236 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b366d655-095a-46b0-97dd-e5a7e4996345 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:09.204690 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b366d655-095a-46b0-97dd-e5a7e4996345 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:09.205461 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b366d655-095a-46b0-97dd-e5a7e4996345 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:09.205903 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-b366d655-095a-46b0-97dd-e5a7e4996345 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:09.337880 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-b366d655-095a-46b0-97dd-e5a7e4996345 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:09.345183 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-b366d655-095a-46b0-97dd-e5a7e4996345 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1452 microversion: 2.1 time: 0.153174 May 16 15:36:09.345748 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 530/1063] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:09 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:09.360750 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-adea8531-9fe0-4102-a241-fc8ba42ad6dc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:36:09.361372 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-adea8531-9fe0-4102-a241-fc8ba42ad6dc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:36:09.367686 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adea8531-9fe0-4102-a241-fc8ba42ad6dc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:09.368140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adea8531-9fe0-4102-a241-fc8ba42ad6dc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:09.368911 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adea8531-9fe0-4102-a241-fc8ba42ad6dc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:09.369377 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-adea8531-9fe0-4102-a241-fc8ba42ad6dc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:09.498194 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-adea8531-9fe0-4102-a241-fc8ba42ad6dc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:36:09.506118 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-adea8531-9fe0-4102-a241-fc8ba42ad6dc tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1452 microversion: 2.1 time: 0.149168 May 16 15:36:09.506685 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 534/1064] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:36:09 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:36:11.392497 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-77fc5d51-9716-4da6-ab66-2e45066cfe80 req-83f80a3f-19c3-48cb-a6d9-abda9e00eff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117ef420-3f60-461e-940a-e7a9a4e85824", "tag": "a5054d8a-54b7-4c5d-bf2b-6bf5e2980688"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:36:11.401453 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-77fc5d51-9716-4da6-ab66-2e45066cfe80 req-83f80a3f-19c3-48cb-a6d9-abda9e00eff9 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:36:11.401832 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-77fc5d51-9716-4da6-ab66-2e45066cfe80 req-83f80a3f-19c3-48cb-a6d9-abda9e00eff9 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:36:11.412950 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-77fc5d51-9716-4da6-ab66-2e45066cfe80 req-83f80a3f-19c3-48cb-a6d9-abda9e00eff9 service nova] Creating event network-changed:a5054d8a-54b7-4c5d-bf2b-6bf5e2980688 for instance 117ef420-3f60-461e-940a-e7a9a4e85824 on hv-cinder-84175 May 16 15:36:11.417885 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-77fc5d51-9716-4da6-ab66-2e45066cfe80 req-83f80a3f-19c3-48cb-a6d9-abda9e00eff9 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030310 May 16 15:36:11.418456 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 531/1065] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:37:01.563934 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:37:01.564633 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Mon May 16 15:37:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:37:06.490763 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:37:06.491342 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Mon May 16 15:37:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:37:10.868626 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:37:10.869066 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Mon May 16 15:37:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:37:42.613640 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-577a52ae-e45d-44a0-89ab-a8abe6772c47 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:42.614262 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-577a52ae-e45d-44a0-89ab-a8abe6772c47 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:42.622281 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-577a52ae-e45d-44a0-89ab-a8abe6772c47 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:42.622730 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-577a52ae-e45d-44a0-89ab-a8abe6772c47 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:42.623534 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-577a52ae-e45d-44a0-89ab-a8abe6772c47 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:42.624007 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-577a52ae-e45d-44a0-89ab-a8abe6772c47 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:42.650131 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-577a52ae-e45d-44a0-89ab-a8abe6772c47 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Going to try to terminate instance {{(pid=117676) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:37:42.702822 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-1601cbff-a368-45ad-acbc-593c7fdd1dea req-85543f02-8a2c-4182-be30-202f9e34578f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117ef420-3f60-461e-940a-e7a9a4e85824", "tag": "a5054d8a-54b7-4c5d-bf2b-6bf5e2980688"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:37:42.712693 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1601cbff-a368-45ad-acbc-593c7fdd1dea req-85543f02-8a2c-4182-be30-202f9e34578f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:42.713143 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1601cbff-a368-45ad-acbc-593c7fdd1dea req-85543f02-8a2c-4182-be30-202f9e34578f service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:42.725063 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-1601cbff-a368-45ad-acbc-593c7fdd1dea req-85543f02-8a2c-4182-be30-202f9e34578f service nova] Creating event network-changed:a5054d8a-54b7-4c5d-bf2b-6bf5e2980688 for instance 117ef420-3f60-461e-940a-e7a9a4e85824 on hv-cinder-84175 May 16 15:37:42.730904 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-1601cbff-a368-45ad-acbc-593c7fdd1dea req-85543f02-8a2c-4182-be30-202f9e34578f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119687 May 16 15:37:42.731508 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 532/1066] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:37:42.973523 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-577a52ae-e45d-44a0-89ab-a8abe6772c47 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "DELETE /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 204 len: 0 microversion: 2.1 time: 0.364675 May 16 15:37:42.983700 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 535/1067] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:37:42 2022] DELETE /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:37:42.983846 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-1c17c74d-c26c-424b-9fb9-9acc7a5a7944 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:42.983944 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-1c17c74d-c26c-424b-9fb9-9acc7a5a7944 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:42.990762 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1c17c74d-c26c-424b-9fb9-9acc7a5a7944 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:42.991216 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1c17c74d-c26c-424b-9fb9-9acc7a5a7944 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:42.992126 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1c17c74d-c26c-424b-9fb9-9acc7a5a7944 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:42.992567 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-1c17c74d-c26c-424b-9fb9-9acc7a5a7944 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:43.125780 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-1c17c74d-c26c-424b-9fb9-9acc7a5a7944 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:37:43.133401 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-1c17c74d-c26c-424b-9fb9-9acc7a5a7944 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1576 microversion: 2.1 time: 0.154641 May 16 15:37:43.133953 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 533/1068] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:42 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:37:44.152252 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b6d42806-6d2e-4c0f-b626-722200096186 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:44.152970 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b6d42806-6d2e-4c0f-b626-722200096186 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:44.159384 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b6d42806-6d2e-4c0f-b626-722200096186 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:44.162436 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b6d42806-6d2e-4c0f-b626-722200096186 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:44.162436 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b6d42806-6d2e-4c0f-b626-722200096186 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:44.162436 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b6d42806-6d2e-4c0f-b626-722200096186 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:44.312140 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-b6d42806-6d2e-4c0f-b626-722200096186 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:37:44.320026 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b6d42806-6d2e-4c0f-b626-722200096186 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1576 microversion: 2.1 time: 0.172680 May 16 15:37:44.322588 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 536/1069] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:44 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:37:45.196738 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [req-1c4f2fb5-8872-4c3c-877e-8c859f0726b2 req-a314174f-6a98-4ed7-bd71-ed9016748025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117ef420-3f60-461e-940a-e7a9a4e85824", "name": "network-vif-deleted", "tag": "a5054d8a-54b7-4c5d-bf2b-6bf5e2980688"}]} {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:37:45.204681 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1c4f2fb5-8872-4c3c-877e-8c859f0726b2 req-a314174f-6a98-4ed7-bd71-ed9016748025 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:45.209883 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [req-1c4f2fb5-8872-4c3c-877e-8c859f0726b2 req-a314174f-6a98-4ed7-bd71-ed9016748025 service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:45.216696 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.compute.server_external_events [req-1c4f2fb5-8872-4c3c-877e-8c859f0726b2 req-a314174f-6a98-4ed7-bd71-ed9016748025 service nova] Creating event network-vif-deleted:a5054d8a-54b7-4c5d-bf2b-6bf5e2980688 for instance 117ef420-3f60-461e-940a-e7a9a4e85824 on hv-cinder-84175 May 16 15:37:45.221993 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [req-1c4f2fb5-8872-4c3c-877e-8c859f0726b2 req-a314174f-6a98-4ed7-bd71-ed9016748025 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029190 May 16 15:37:45.222561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 534/1070] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:37:45.337762 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-2fa47064-0ab5-4f7b-8df1-873828eae889 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:45.338411 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-2fa47064-0ab5-4f7b-8df1-873828eae889 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:45.347309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2fa47064-0ab5-4f7b-8df1-873828eae889 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:45.347309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2fa47064-0ab5-4f7b-8df1-873828eae889 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:45.347309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2fa47064-0ab5-4f7b-8df1-873828eae889 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:45.347309 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-2fa47064-0ab5-4f7b-8df1-873828eae889 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:45.409325 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-2fa47064-0ab5-4f7b-8df1-873828eae889 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:37:45.417412 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-2fa47064-0ab5-4f7b-8df1-873828eae889 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1224 microversion: 2.1 time: 0.084254 May 16 15:37:45.417968 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 537/1071] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:45 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:37:46.434852 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:46.435534 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:46.442158 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:46.442606 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:46.443713 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:46.444148 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:46.476017 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:46.476388 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:46.476835 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.objects.instance [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lazy-loading 'fault' on Instance uuid 117ef420-3f60-461e-940a-e7a9a4e85824 {{(pid=117677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:37:46.517827 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:37:46.524517 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-118e1db1-8349-4cf3-8d90-4c1ceed7db05 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 200 len: 1183 microversion: 2.1 time: 0.093887 May 16 15:37:46.525222 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 535/1072] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:46 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 1183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:37:47.542879 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:47.543546 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 117ef420-3f60-461e-940a-e7a9a4e85824] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:47.549946 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:47.550393 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:47.551165 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:47.551601 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:47.565152 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] HTTP exception thrown: Instance 117ef420-3f60-461e-940a-e7a9a4e85824 could not be found. May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Request method failure captured: May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 HTTP/1.1 May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigm4w5dWjXZwZ8tt77b9l5vmmjI-WnLBf3G8z-U_LGyMzX7N3GbsczecthfRHPwtlfwsnwb30i8Ms1GkRQsIai7OwXPtxEJCg5hQKPip0jRactLuDZI6JuT85I_7RNt3AwD6FaNfBNRP7yLWP407mpAbhtfIOv1ZJ2OTZqUpGS5x6qeI May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 35be16de8a104d569efbb5633c5036af May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:37:47.566751 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/35be16de8a104d569efbb5633c5036af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_35be16de8a104d569efbb5633c5036af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}] May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 35be16de8a104d569efbb5633c5036af May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-TestVolumeBootPattern-1823841486-project May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 1f3e4b15a6cc4879b24d7a44669a3690 May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-TestVolumeBootPattern-1823841486-project May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 117ef420-3f60-461e-940a-e7a9a4e85824 could not be found. May 16 15:37:47.569200 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '117ef420-3f60-461e-940a-e7a9a4e85824'} May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117ef420-3f60-461e-940a-e7a9a4e85824 could not be found. May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:37:47.570524 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117ef420-3f60-461e-940a-e7a9a4e85824 could not be found. May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117ef420-3f60-461e-940a-e7a9a4e85824 could not be found. May 16 15:37:47.572193 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:47.573561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Returning 404 to user: Instance 117ef420-3f60-461e-940a-e7a9a4e85824 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:37:47.573561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-9892d6fa-a7cd-43fa-99aa-fa084b590d2d tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824" status: 404 len: 111 microversion: 2.1 time: 0.029172 May 16 15:37:47.573561 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 538/1073] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:47 2022] GET /compute/v2.1/servers/117ef420-3f60-461e-940a-e7a9a4e85824 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:37:50.833972 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-2e73b87f-4ad0-4e69-9546-f7c8cdf736b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:50.834555 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2e73b87f-4ad0-4e69-9546-f7c8cdf736b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:50.840917 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-6c04977a-0127-43e5-adb6-d14495d04cc8 req-80ee19b1-c177-4778-80fc-2168ff975e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1", "tag": "b8b5421f-ded5-4aa6-b059-4ba9b102a4af"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:37:50.853443 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2e73b87f-4ad0-4e69-9546-f7c8cdf736b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:50.854062 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2e73b87f-4ad0-4e69-9546-f7c8cdf736b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:50.855150 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2e73b87f-4ad0-4e69-9546-f7c8cdf736b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:50.855600 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-2e73b87f-4ad0-4e69-9546-f7c8cdf736b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:50.862619 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-6c04977a-0127-43e5-adb6-d14495d04cc8 req-80ee19b1-c177-4778-80fc-2168ff975e6a service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:50.863066 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-6c04977a-0127-43e5-adb6-d14495d04cc8 req-80ee19b1-c177-4778-80fc-2168ff975e6a service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:50.875191 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-6c04977a-0127-43e5-adb6-d14495d04cc8 req-80ee19b1-c177-4778-80fc-2168ff975e6a service nova] Creating event network-changed:b8b5421f-ded5-4aa6-b059-4ba9b102a4af for instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 on hv-cinder-84175 May 16 15:37:50.880420 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-6c04977a-0127-43e5-adb6-d14495d04cc8 req-80ee19b1-c177-4778-80fc-2168ff975e6a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043536 May 16 15:37:50.881304 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 539/1074] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:37:50.885418 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-2e73b87f-4ad0-4e69-9546-f7c8cdf736b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Going to try to terminate instance {{(pid=117677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:37:51.175198 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-2e73b87f-4ad0-4e69-9546-f7c8cdf736b5 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "DELETE /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 204 len: 0 microversion: 2.1 time: 0.344967 May 16 15:37:51.179273 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 536/1075] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:37:50 2022] DELETE /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:37:51.185290 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-1e9f0bea-6dda-46e6-8760-89b00398d9d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:51.186263 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-1e9f0bea-6dda-46e6-8760-89b00398d9d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:51.193066 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1e9f0bea-6dda-46e6-8760-89b00398d9d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:51.193517 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1e9f0bea-6dda-46e6-8760-89b00398d9d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:51.194299 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1e9f0bea-6dda-46e6-8760-89b00398d9d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:51.194734 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-1e9f0bea-6dda-46e6-8760-89b00398d9d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:51.430918 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.policy [None req-1e9f0bea-6dda-46e6-8760-89b00398d9d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117676) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:37:51.438275 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-1e9f0bea-6dda-46e6-8760-89b00398d9d6 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1577 microversion: 2.1 time: 0.257479 May 16 15:37:51.438831 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 540/1076] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:51 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1577 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:37:52.456878 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-7a5563b4-2620-4b7e-a58b-bc0eab5b610a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:52.457576 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-7a5563b4-2620-4b7e-a58b-bc0eab5b610a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:52.464542 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7a5563b4-2620-4b7e-a58b-bc0eab5b610a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:52.465561 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7a5563b4-2620-4b7e-a58b-bc0eab5b610a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:52.466408 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7a5563b4-2620-4b7e-a58b-bc0eab5b610a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:52.467030 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-7a5563b4-2620-4b7e-a58b-bc0eab5b610a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:52.624647 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-7a5563b4-2620-4b7e-a58b-bc0eab5b610a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:37:52.632784 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-7a5563b4-2620-4b7e-a58b-bc0eab5b610a tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1577 microversion: 2.1 time: 0.180226 May 16 15:37:52.633364 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 537/1077] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:52 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:37:53.262658 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [req-3c69751d-5559-4141-9b0d-cbdd9e4290e5 req-138465bd-38c6-446d-b854-4011365aa64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1", "name": "network-vif-deleted", "tag": "b8b5421f-ded5-4aa6-b059-4ba9b102a4af"}]} {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:37:53.271948 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-3c69751d-5559-4141-9b0d-cbdd9e4290e5 req-138465bd-38c6-446d-b854-4011365aa64e service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:53.272460 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [req-3c69751d-5559-4141-9b0d-cbdd9e4290e5 req-138465bd-38c6-446d-b854-4011365aa64e service nova] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:53.283180 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.compute.server_external_events [req-3c69751d-5559-4141-9b0d-cbdd9e4290e5 req-138465bd-38c6-446d-b854-4011365aa64e service nova] Creating event network-vif-deleted:b8b5421f-ded5-4aa6-b059-4ba9b102a4af for instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 on hv-cinder-84175 May 16 15:37:53.289073 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [req-3c69751d-5559-4141-9b0d-cbdd9e4290e5 req-138465bd-38c6-446d-b854-4011365aa64e service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030039 May 16 15:37:53.289861 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 541/1078] 10.222.0.71 () {64 vars in 1317 bytes} [Mon May 16 15:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:37:53.650383 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-983a4622-195d-4ab4-9c7d-27e95d112e68 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:53.651000 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-983a4622-195d-4ab4-9c7d-27e95d112e68 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:53.657923 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-983a4622-195d-4ab4-9c7d-27e95d112e68 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:53.658637 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-983a4622-195d-4ab4-9c7d-27e95d112e68 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:53.659429 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-983a4622-195d-4ab4-9c7d-27e95d112e68 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:53.659904 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-983a4622-195d-4ab4-9c7d-27e95d112e68 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:53.725387 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.policy [None req-983a4622-195d-4ab4-9c7d-27e95d112e68 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3e4b15a6cc4879b24d7a44669a3690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35be16de8a104d569efbb5633c5036af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117677) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:37:53.737536 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-983a4622-195d-4ab4-9c7d-27e95d112e68 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 200 len: 1224 microversion: 2.1 time: 0.087041 May 16 15:37:53.737536 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 538/1079] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:53 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:37:54.751275 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:54.752008 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:54.758968 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:54.759425 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:54.760242 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:54.760693 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:54.774694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] HTTP exception thrown: Instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 could not be found. May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Request method failure captured: May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 HTTP/1.1 May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigm4w5dWjXZwZ8tt77b9l5vmmjI-WnLBf3G8z-U_LGyMzX7N3GbsczecthfRHPwtlfwsnwb30i8Ms1GkRQsIai7OwXPtxEJCg5hQKPip0jRactLuDZI6JuT85I_7RNt3AwD6FaNfBNRP7yLWP407mpAbhtfIOv1ZJ2OTZqUpGS5x6qeI May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 35be16de8a104d569efbb5633c5036af May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:37:54.776485 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/35be16de8a104d569efbb5633c5036af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_35be16de8a104d569efbb5633c5036af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}] May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 35be16de8a104d569efbb5633c5036af May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-TestVolumeBootPattern-1823841486-project May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 1f3e4b15a6cc4879b24d7a44669a3690 May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-TestVolumeBootPattern-1823841486-project May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 could not be found. May 16 15:37:54.778072 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': '89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1'} May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 could not be found. May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:37:54.779110 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 could not be found. May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 could not be found. May 16 15:37:54.780694 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:54.782172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Returning 404 to user: Instance 89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:37:54.782172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-b95433cc-d32f-4dd3-8af7-44dd17ae6c5f tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1" status: 404 len: 111 microversion: 2.1 time: 0.031322 May 16 15:37:54.782172 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 542/1080] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:54 2022] GET /compute/v2.1/servers/89b2cf38-3e3e-4ec8-831a-6dc75fb79dc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:37:55.301271 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:55.301786 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.compute.api [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117677) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:55.308775 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:55.309221 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:55.310036 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:55.310463 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG oslo_concurrency.lockutils [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:55.323703 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.wsgi [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] HTTP exception thrown: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Request method failure captured: May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: request: DELETE /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 HTTP/1.1 May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept: application/json May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Accept-Encoding: identity May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Connection: close May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Length: 0 May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Content-Type: application/json May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Host: 10.222.0.71 May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Openstack-System-Scope: None May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: User-Agent: python-urllib3/1.26.9 May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Auth-Token: gAAAAABigm4w5dWjXZwZ8tt77b9l5vmmjI-WnLBf3G8z-U_LGyMzX7N3GbsczecthfRHPwtlfwsnwb30i8Ms1GkRQsIai7OwXPtxEJCg5hQKPip0jRactLuDZI6JuT85I_7RNt3AwD6FaNfBNRP7yLWP407mpAbhtfIOv1ZJ2OTZqUpGS5x6qeI May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Id: None May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Domain-Name: None May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Identity-Status: Confirmed May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Is-Admin-Project: True May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Id: default May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Domain-Name: Default May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Id: 35be16de8a104d569efbb5633c5036af May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Project-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Role: member,reader May 16 15:37:55.325328 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Roles: member,reader May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/35be16de8a104d569efbb5633c5036af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_35be16de8a104d569efbb5633c5036af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}] May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Id: 35be16de8a104d569efbb5633c5036af May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User: tempest-TestVolumeBootPattern-1823841486-project May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Id: default May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Domain-Name: Default May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Id: 1f3e4b15a6cc4879b24d7a44669a3690 May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: X-User-Name: tempest-TestVolumeBootPattern-1823841486-project May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: method: > May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: exception: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.326969 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: action_args: {'id': 'e65e6a25-7f99-47a1-bbcb-cdc660b97721'} May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:37:55.328115 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.329709 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: ERROR nova.api.openstack.wsgi May 16 15:37:55.331339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Returning 404 to user: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. {{(pid=117677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:37:55.331339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-33d39148-4aeb-4198-a412-18db5cb50df7 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 404 len: 111 microversion: 2.1 time: 0.029349 May 16 15:37:55.331339 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 539/1081] 10.222.0.71 () {58 vars in 1238 bytes} [Mon May 16 15:37:55 2022] DELETE /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:37:55.335464 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '>' {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:55.336119 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.compute.api [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] [instance: e65e6a25-7f99-47a1-bbcb-cdc660b97721] Fetching instance by UUID {{(pid=117676) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:37:55.342052 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:55.342506 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:55.346148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:37:55.346148 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG oslo_concurrency.lockutils [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Lock "f0d3babb-5d7b-45d9-bcb1-3c089af1ca15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:37:55.357448 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.wsgi [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] HTTP exception thrown: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Request method failure captured: May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: request: GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 HTTP/1.1 May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept: application/json May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Accept-Encoding: identity May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Connection: close May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Length: 0 May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Content-Type: application/json May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Host: 10.222.0.71 May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Openstack-System-Scope: None May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: User-Agent: python-urllib3/1.26.9 May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Auth-Token: gAAAAABigm4w5dWjXZwZ8tt77b9l5vmmjI-WnLBf3G8z-U_LGyMzX7N3GbsczecthfRHPwtlfwsnwb30i8Ms1GkRQsIai7OwXPtxEJCg5hQKPip0jRactLuDZI6JuT85I_7RNt3AwD6FaNfBNRP7yLWP407mpAbhtfIOv1ZJ2OTZqUpGS5x6qeI May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Id: None May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Domain-Name: None May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Identity-Status: Confirmed May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Is-Admin-Project: True May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Id: default May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Domain-Name: Default May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Id: 35be16de8a104d569efbb5633c5036af May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Project-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Role: member,reader May 16 15:37:55.358944 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Roles: member,reader May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/35be16de8a104d569efbb5633c5036af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.71:8080", "publicURL": "http://10.222.0.71:8080/v1/AUTH_35be16de8a104d569efbb5633c5036af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/35be16de8a104d569efbb5633c5036af"}]}] May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Id: 35be16de8a104d569efbb5633c5036af May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823841486 May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User: tempest-TestVolumeBootPattern-1823841486-project May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Id: default May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Domain-Name: Default May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Id: 1f3e4b15a6cc4879b24d7a44669a3690 May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: X-User-Name: tempest-TestVolumeBootPattern-1823841486-project May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: method: > May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: exception: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.360726 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: action_args: {'id': 'e65e6a25-7f99-47a1-bbcb-cdc660b97721'} May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: {{(pid=117676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:37:55.362062 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. May 16 15:37:55.363587 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: ERROR nova.api.openstack.wsgi May 16 15:37:55.365740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: DEBUG nova.api.openstack.wsgi [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Returning 404 to user: Instance e65e6a25-7f99-47a1-bbcb-cdc660b97721 could not be found. {{(pid=117676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:37:55.365740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO nova.api.openstack.requestlog [None req-925deb61-57ea-42e4-b5ef-32a4613749f9 tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721" status: 404 len: 111 microversion: 2.1 time: 0.028939 May 16 15:37:55.365740 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: [pid: 117676|app: 0|req: 543/1082] 10.222.0.71 () {58 vars in 1235 bytes} [Mon May 16 15:37:55 2022] GET /compute/v2.1/servers/e65e6a25-7f99-47a1-bbcb-cdc660b97721 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:37:56.819917 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: DEBUG nova.api.openstack.wsgi [None req-92f46dbb-8d7a-44c4-8b6f-af9d3168feae tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] Calling method '.version_select at 0x7f0c88206280>' {{(pid=117677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:37:56.907733 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO nova.api.openstack.requestlog [None req-92f46dbb-8d7a-44c4-8b6f-af9d3168feae tempest-TestVolumeBootPattern-1823841486 tempest-TestVolumeBootPattern-1823841486-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-357988655" status: 202 len: 0 microversion: 2.1 time: 0.092026 May 16 15:37:56.908314 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: [pid: 117677|app: 0|req: 540/1083] 10.222.0.71 () {58 vars in 1259 bytes} [Mon May 16 15:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-357988655 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:38:36.212806 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:38:36.213487 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Mon May 16 15:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:40:21.571854 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:40:21.572486 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Mon May 16 15:40:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:40:26.499203 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:40:26.499828 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Mon May 16 15:40:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:40:30.877547 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:40:30.878700 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Mon May 16 15:40:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:40:33.003765 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:40:33.004385 dv-cinder-841753-2-iscsi devstack@n-api.service[117676]: Mon May 16 15:40:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:40:39.382005 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:40:39.382613 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Mon May 16 15:40:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:41:56.221153 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:41:56.221829 dv-cinder-841753-2-iscsi devstack@n-api.service[117677]: Mon May 16 15:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!